Apache Spark is a unified analytics engine for large-scale data processing. I added certain extension point enhancement that we need for OSS project Spline. Spline is data lineage tracking tool that I work on for ABSA.
Finally my rather small pull request was merged into master of Apache Spark!
Apache Spark is a unified analytics engine for large-scale data processing. I added certain extension point enhancement that we need for OSS project Spline. Spline is data lineage tracking tool that I work on for ABSA.