Python (PySpark) Engineer - Pasig, Metro Manila
Para lamang sa mga rehistradong miyembro Pasig, Metro Manila, Pilipinas
1 buwan ang nakalipas
* Ang saklaw ng suweldo na ito ay isang pagtatantya na ginawa ng beBee
Job summary
Design, develop, and maintain big data solutions using Apache Spark (Batch and Streaming) and collaborate with data scientists and analysts to deliver robust data solutions for analytics and machine learning.
Qualifications
- Bachelor's degree in Computer Science, Engineering, or related field (Master's preferred).
- 3+ years of hands on experience with Apache Spark (Core, SQL, Streaming).
- Strong programming skills in Scala, Java, or Python (PySpark).
Responsibilities
- Build data pipelines for processing structured, semi-structured, and unstructured data from multiple sources.
- Optimize Spark jobs for performance and scalability across large datasets.
- Integrate Spark with various data storage systems (HDFS, S3, Hive, Cassandra, etc.).
Skills
- Strong background in performance tuning and Spark job optimization.
- Experience with CI/CD pipelines and version control (Git).
- Familiarity with containerization (Docker, Kubernetes) is an advantage.
Benefits
- Ensure security and compliance of data processing systems.
- Troubleshoot and resolve data pipeline and Spark job issues in production environments.
Paglalarawan ng trabaho
Lorem ipsum dolor sit amet
, consectetur adipiscing elit. Nullam tempor vestibulum ex, eget consequat quam pellentesque vel. Etiam congue sed elit nec elementum. Morbi diam metus, rutrum id eleifend ac, porta in lectus. Sed scelerisque a augue et ornare.
Donec lacinia nisi nec odio ultricies imperdiet.
Morbi a dolor dignissim, tristique enim et, semper lacus. Morbi laoreet sollicitudin justo eget eleifend. Donec felis augue, accumsan in dapibus a, mattis sed ligula.
Vestibulum at aliquet erat. Curabitur rhoncus urna vitae quam suscipit
, at pulvinar turpis lacinia. Mauris magna sem, dignissim finibus fermentum ac, placerat at ex. Pellentesque aliquet, lorem pulvinar mollis ornare, orci turpis fermentum urna, non ullamcorper ligula enim a ante. Duis dolor est, consectetur ut sapien lacinia, tempor condimentum purus.
, consectetur adipiscing elit. Nullam tempor vestibulum ex, eget consequat quam pellentesque vel. Etiam congue sed elit nec elementum. Morbi diam metus, rutrum id eleifend ac, porta in lectus. Sed scelerisque a augue et ornare.
Donec lacinia nisi nec odio ultricies imperdiet.
Morbi a dolor dignissim, tristique enim et, semper lacus. Morbi laoreet sollicitudin justo eget eleifend. Donec felis augue, accumsan in dapibus a, mattis sed ligula.
Vestibulum at aliquet erat. Curabitur rhoncus urna vitae quam suscipit
, at pulvinar turpis lacinia. Mauris magna sem, dignissim finibus fermentum ac, placerat at ex. Pellentesque aliquet, lorem pulvinar mollis ornare, orci turpis fermentum urna, non ullamcorper ligula enim a ante. Duis dolor est, consectetur ut sapien lacinia, tempor condimentum purus.
Makakuha ng buong pag-access
I-access ang lahat ng mataas na antas na posisyon at kunin ang trabaho ng iyong mga pangarap.