Wynd Labs
Data Engineer
NEWRemoteFull-timeGlobal
š Midš Remote
RemoteRemote work position availableActivePosted within the last 30 days
Job Description
[AI-summarized by JobStash]
You will design, build, and optimize scalable data pipelines to ingest, transform, and serve large volumes of web and multimedia data. You will develop and manage ETL/ELT workflows, integrate and tune cloud database infrastructure, automate infrastructure and data workflows, and monitor and troubleshoot pipeline performance to ensure data quality and availability.
Requirements
- āBachelor's degree in Computer Science, Information Systems, Data Engineering, or related field
- āExtensive experience with cloud data warehouse systems such as Redshift or Snowflake
- āAdvanced proficiency in SQL and query performance optimization
- āExperience building and managing data pipelines with Airflow, AWS Glue, or similar tools
- āStrong understanding of ETL processes and data integration best practices
- āExperience with infrastructure automation tools such as Terraform or CloudFormation
- āProficiency in Python, Scala, or Java for pipeline orchestration and data manipulation
- āFamiliarity with containerization and orchestration using Docker and Kubernetes
- āStrong analytical and problem-solving skills
Responsibilities
- āDesign scalable data pipelines for batch and real-time processing
- āDevelop and manage ETL/ELT workflows to transform raw data into structured formats
- āIntegrate and configure database infrastructure for performance and scalability
- āAutomate data workflows and infrastructure setup using infrastructure as code
- āCollaborate with data scientists and analysts to ensure data accessibility
- āMonitor, troubleshoot, and improve pipeline and infrastructure performance
- āManage cloud databases, storage, and compute resources efficiently
- āImplement data governance, data security, and disaster recovery practices
Benefits & Perks
- āRemote work
- āEquity package
- āBenefits package
Tech Stack
data pipelineELTdata securitydata governanceGlueETLAWS GlueAirflowSnowflakeKubernetesproject:Wynd Network