(Senior) Data Engineer - fully remote possible
We work and play together. We value work-life balance and create a culture of respect, trust and equality. If these values are also key for you, there is a good chance that you will find your place with us.
Join the limango IT!
- In the limango IT you get the chance to contribute your own ideas and know-how to maintain and develop our highly frequented, self built online shop for our markets in Poland, Germany, Austria and the Netherlands
- Together with our experienced and international development teams you will bring our shop sites to the next level: Contribute your expertise to our Access, Shop and Checkout Teams!
- You will work in a modern tech stack world: React frontend, cloud-based & virtualized infrastructure, service-oriented architecture & event based communication
- The following technologies await you: AWS, docker, kubernetes, microservices, GoLang, React, JSS, Jest, ES6/Typescript
- We work agile: You will become a part of our well-rehearsed agile teams of versatile and experienced Web Developers, dedicated Product Owner and Scrum Master
Tasks and Role
- Develop a Central Lakehouse Data Platform leveraging the AWS and Databricks ecosystems.
- Manage data infrastructure using Terraform (AWS/Databricks) and ETL code with PySpark, Delta Live Tables, and SparkSQL.
- Implement monitoring, data quality tests, unit testing, and automated alerts within the system.
- Refactor legacy AWS solutions (AWS Glue, Redshift) into a modern, monitored, and CI/CD-deployed Lakehouse ecosystem with data expectations and quality testing.
- Actively contribute to building a medallion lakehouse architecture for ML and analytics data, and introduce data-mesh concepts.
- Provide active support to business analytics and ML teams working on the data platform.
- Candidate's Profile
- Hands-on experience with Terraform and PySpark is a must, at least at a basic level.
- A degree in Information Systems, Computer Science, Mathematics/Physics, Engineering, or a related field.
- Several years of experience building data engineering solutions (experience in E-commerce is a plus).
- Strong proficiency in Python programming, including application development, automated testing, packaging, and deployment.
- Real-world experience with PySpark for data processing and a solid understanding of the Spark processing engine architecture.
- Advanced SQL skills for complex data processing.
- Experience with data lakes architecture and data modeling paradigms.
- Proficiency in Terraform for infrastructure-as-code and experience with CI/CD deployments.
- Proven experience building and deploying data engineering ETL applications in CI/CD pipeline environments (e.g., Git).
- Fluency in English to thrive in an international environment.
- A team-player attitude with a willingness to learn modern technologies and frameworks.
- Familiarity with AWS Cloud architecture and the Databricks platform is highly welcomed.
- Experience with AWS Glue and Redshift warehousing.
- Knowledge of CloudFormation templates.
- Hands-on experience with AWS Kinesis and Spark streaming processing.
- Good knowledge of Scala, functional programming, and application development.
- Experience with MLOps environments (e.g., MLFlow).
What you can count for?
- Exciting challenges and a huge influence on our project and business – you’ll be responsible for bringing our new projects live,
- Flat hierarchies, and direct communication in a very comradely atmosphere,
- A steep learning curve in a dynamic company with international orientation,
- Flexible working hours and either B2B or contract of employment,
- Stability in those pandemic times – growing, profitable business and proper safety rules,
- Possibility to develop your skills, thanks to trainings and cooperation with international experts.
Benefits
- Private healthcare
We provide access to the best specialists for you and your loved ones. - Language classes
English and German lessons in small groups, tailored to your skills. - Remote work and flexible working hours
Possibility of partial remote work, as well as adjusting working hours to your daily schedule. - Office in the center of Wrocław
Nearby cinema, fitness club and large selection of lunch places. - Fruit Mondays
There is no shortage of coffee, fruit, pizza, sweets and healthy snacks in our office. - Company events in the best company
After hours we often organize interesting outings or meetings in our office.
Sounds good?
