Luxor Technology
Data Engineer
NEWWorldwide, Remote, Argentina, ...Full-timeGlobal
š Midš Remote
RemoteRemote work position availableActivePosted within the last 30 days
Job Description
[AI-summarized by JobStash]
You will build scalable and reliable data pipelines, develop and maintain streaming and batch ETL, and administer large cloud-deployed relational and non-relational databases. You will design, document, automate and execute test plans to ensure dataset quality, collaborate on architecture with an emphasis on scalability and security, drive systems toward near real-time operation, and participate in generating and analyzing features.
Requirements
- āExperience building streaming and batch data pipelines and ETL
- āExpertise in Python
- āExpertise in PostgreSQL and PL/pgSQL development and administration of large databases
- āExperience with scalability solutions and multi-region replication and failover
- āExperience with data warehouse technologies such as Trino, ClickHouse, and Airflow
- āBachelor's degree in Computer Science, Engineering, or related field or equivalent experience
- āDeep understanding of programming and experience with at least one programming language
- āEnglish language proficiency
- āKnowledge of Kubernetes and Docker
- ā4+ years of working experience in relevant data field
- āKnowledge of blockchain technology or the mining pool industry
- āExperience with agile development methodology
- āExperience delivering and owning web-scale data systems in production
- āExperience with Kafka, preferably Redpanda and Redpanda Connect
Responsibilities
- āBuild scalable and reliable data pipelines that provide accurate data feeds from internal and external systems
- āGovern scalable and performant cloud-deployed production relational and non-relational databases
- āCollaborate on architecture definitions with a focus on scalable and secure solutions
- āDrive data systems to be as near real-time as possible
- āDesign, document, automate and execute test plans to ensure dataset quality
- āParticipate in generating and analyzing features
Tech Stack
database administrationReplicationRedpandaKafkaETLdata warehouseTrinoAirflowKubernetesDocker