CSM Technologies, Inc
Wilmington, Delaware, 19801
Responsibilities: Develop and maintain data platforms using Python, Spark, and PySpark. Handle migration to PySpark on AWS. Design and implement data pipelines. Work with AWS and Big Data. Produce unit tests for Spark transformations and helper methods. Create Scala/Spark jobs for data transformation and aggregation. Write Scala doc-style documentation for code. Optimize Spark queries for performa