PySpark Developer Job at Snowrelic Inc, Iselin, NJ

cDhFd0dZVFBreVhLRWZ1UWFuaEIwZDE3YlE9PQ==
  • Snowrelic Inc
  • Iselin, NJ

Job Description

We are seeking a Pyspark Developer to build robust data processing solutions on Azure Cloud using PySpark to drive innovation within the financial services industry. Our challenge is to leverage extensive PySpark experience and hands-on expertise in Azure Cloud to navigate the complexities of big data, ensuring compliance with industry standards while delivering impactful results. We aim to rapidly adapt to evolving technologies and create scalable data solutions that enhance operational efficiency and decision-making.

Responsibilities:

  • Develop, maintain, and optimize data processing pipelines using PySpark on Azure Cloud.

  • Collaborate with cross-functional teams to understand data requirements and translate business needs into technical specifications.

  • Design and implement scalable data models and data architecture to support analytical and reporting needs.

  • Perform data cleansing, transformation, and enrichment processes to enhance data quality and usability.

  • Monitor and troubleshoot data processing jobs, ensuring high availability and performance.

  • Implement best practices for data governance and security within Azure Cloud.

  • Stay up-to-date with emerging technologies in big data, cloud computing, and the financial services industry.

Requirements:

  • Minimum of 9 years of experience in PySpark development.

  • Proven experience working with Azure Cloud services (Azure Data Factory, Azure Databricks, etc.).

  • Prior experience in the banking, investment banking, or financial services sector is mandatory.

  • Proficient in PySpark for data processing and ETL tasks.

  • Experience with SQL and NoSQL databases.

  • Familiarity with data warehousing concepts and tools.

  • Knowledge of Azure services related to big data and analytics.

Preferred, but not required:

  • Experience with containerization technologies (e.g., Docker, Kubernetes).

  • Familiarity with machine learning frameworks (e.g., MLlib, TensorFlow).

Job Tags

Similar Jobs

Fresh Prints

Remote Customer Success Specialist Job at Fresh Prints

About Frontier Frontier is a subsidiary of Fresh Prints . Fresh Prints is a New York-based, fast-growing, fully remote, 150-person company with most of our team based in India and the Philippines. A few years ago, Fresh Prints began helping other fast-growing companies...

Gotham Enterprises Ltd

Licensed Professional Counselor (LPC) Job at Gotham Enterprises Ltd

 ...Licensed Professional Counselor (LPC) New Jersey Employment Type: Full-Time Location: Vineland, New Jersey Salary: $100,000.00 - $110,000 per year + benefits We are actively seeking a Licensed Professional Counselor (LPC) to join our mental health team in... 

Duolingo

Social Media Community Manager Job at Duolingo

 ...develop education for our half a billion (and growing!) learners around the world. About The Role We are seeking a Social Community Manager to help engage with Duolingos social media community. With a large presence on YouTube Shorts, TikTok, and Instagram Reels,... 

Xylem

Contract Manager Job at Xylem

 ...position will provide support and guidance to the business and our customers in the review of contract documents, bids, and proposals. Performing moderate to complex contract management duties and displaying a high level of critical thinking in bringing a successful... 

Netsync Network Solutions

Computer Technician Job at Netsync Network Solutions

 ...Detailed Description Description: A Computer Technician whose responsibilities will include, but not be limited to day-to-day management of workload, laptop/desktop/printer triage and repair, interaction with Netsync warranty administrators and maintenance of proper...