Highlights
Develop scalable data pipelines, optimize PostgreSQL performance, build reliable backend services.
Description
Job Summary
pDigantara, a leading Space Surveillance and Intelligence company, seeks a Data Platform Engineer to develop and operate scalable data pipelines for mission-critical space data. This role involves building reliable backend services, optimizing database performance, and contributing to CI/CD workflows.
Responsibilities
- Develop and maintain data pipelines for ingestion, transformation, validation, and enrichment of operational datasets.
- Build and support Apache Airflow workflows integrating satellite tracking, sensor, and external data sources.
- Assist in designing and optimizing PostgreSQL schemas, queries, and database performance.
- Develop backend services and APIs for dataset access and delivery.
- Support containerized deployments using Docker and contribute to CI/CD workflows.
- Monitor pipeline performance, troubleshoot issues, and improve operational reliability.
- Contribute to testing, documentation, and continuous improvement of data platform capabilities.
- Collaborate with software, platform, and domain teams to integrate data services into production systems.
Required Skills
- Data Pipelines
- Apache Airflow
- PostgreSQL Optimization
- Backend Services Development
- CI/CD Practices
Required Skills Explained
- Python: Essential for developing data pipelines and backend services.
- PostgreSQL: Crucial for database management and query optimization.
- Airflow: Important for orchestrating workflows to manage complex data processing tasks.
- Docker: Used for containerized deployments, ensuring consistency in development and production environments.
Who is this for
pThis role is ideal for candidates with a strong background in backend development and data engineering, particularly those passionate about solving complex problems in a collaborative environment. Experience in space-based systems or large-scale analytical datasets is a plus.
Why This Job is a Good Opportunity
ulliContribute to cutting-edge technology in space surveillance and intelligence.liWork with a motivated team focused on ensuring orbital safety and sustainability.liGain valuable experience in building scalable data platforms and backend services.liPotential for growth in a rapidly expanding field of space technology.
Interview Preparation Tips
- Familiarize yourself with Python, PostgreSQL, and Apache Airflow concepts.
- Prepare examples or projects demonstrating your experience in data engineering workflows.
- Briefly explain how you have optimized database performance and developed backend services before.
- Discuss your understanding of CI/CD practices and cloud-native development environments.
Career Growth in This Role
pThis role offers significant opportunities for career growth as you will work with a team that values innovation and collaboration. You can expect to progress into more senior roles such as Lead Data Platform Engineer or Technical Architect, where you would oversee the entire data platform lifecycle. The fast-paced environment at Digantara also encourages continuous learning and skill development in advanced topics like machine learning and big data analytics.
Explore More Opportunities
Skills
Frequently Asked Questions
What programming languages are required for this role?Python is the primary language needed, with experience in other languages like Go being beneficial.
Is prior experience with space-based systems necessary?While not mandatory, exposure to space-based systems or large-scale analytical datasets is advantageous.
What kind of support will I get for CI/CD workflows?You’ll have the opportunity to learn and contribute to our CI/CD practices using modern tools and techniques.