- 1. Design, develop, and maintain highly scalable, reliable, and efficient data processing systems with a strong emphasis on code quality and performance.
- 2. Collaborate closely with data analysts, software developers, and business stakeholders to deeply understand data requirements and architect robust solutions to address their needs.
- 3. Focus on the development and maintenance of ETL pipelines, ensuring seamless extraction, transformation, and loading of data from diverse sources into our data warehouse based on Data-bricks platform.
- 4. Spearhead the development and maintenance of real-time data processing systems utilizing cutting-edge big data technologies such as Spark Streaming and Kafka.
- 5. Establish and enforce rigorous data quality and validation checks to uphold the accuracy and consistency of our data assets.
- 6. Act as a point of contact for troubleshooting and resolving complex data processing issues, collaborating with cross-functional teams as necessary to ensure timely resolution.
- 7. Proactively monitor and optimize data processing systems to uphold peak performance, scalability, and reliability standards, leveraging advanced AWS operational knowledge.
- 8. Utilize AWS services such as EC2, S3, Glue and Data-bricks to architect, deploy, and manage data processing infrastructure in the cloud.
- 9. Implement robust security measures and access controls to safeguard sensitive data assets within the AWS environment.
- 10. Stay abreast of the latest advancements in AWS technologies and best practices, incorporating new tools and services to continually improve our data processing capabilities.
- Requirements:
- 1. Bachelor's or Master's degree in Computer Science or a related field.
- 2. Minimum of 5 years of hands-on experience as a Data Engineer, demonstrating a proven track record of designing and implementing sophisticated data processing systems.
- 4. Good understanding of Data-bricks platform and Delta Lake.
- Familiar with data job scheduler tool such as Dagster.
- 5. Proficiency in one or more programming languages such as Scala, Java, or Python.
- 6. Deep expertise in big data technologies including Apache Spark for ETL processing and optimization.
- 7. Proficient in utilizing BI tools such as Metabase for data visualization and analysis.
- 8. Advanced understanding of data modeling, data quality, and data governance best practices.
- 9. Outstanding communication and collaboration skills, with the ability to effectively engage with diverse stakeholders across the organization.
- 10. Extensive experience in AWS operational management, including deployment, configuration, and optimization of data processing infrastructure within the AWS cloud environment.
- 11. Strong understanding of AWS services such as EC2, S3, Glue and EMR, with the ability to architect scalable and resilient data solutions leveraging these services.
- 12. Proficiency in AWS security best practices, with experience implementing robust security measures and access controls to protect sensitive data assets.
- 13. Hands-on experience with automation and DevOps tools such as Terraform for infrastructure as code and automation purposes.
- 14. Can read/write in English.Join the Coins Team NowMeaningful Collaborations - The successful candidate will work cross-functionally with other relevant teams to carry out implementations that will improve and create an impact on customer experience.
Scalable Growth - Be part of a fast-growing organization with the vision to expand its territories outside APAC which will provide opportunities for career advancement.
A Space For Bright Ideas - Let your bright ideas be converted into meaningful changes Coins culture welcomes new ideas backed up by data to create an impact.
-
Eraneos Shanghai, 中国 全职Das findest Du bei uns · Wir sind ein technisches, umsetzungsorientiertes Spin-Off einer global agierenden Managementberatung. Zu unseren Kunden gehören primär DAX und Fortune Global 500 Unternehmen, die wir zu Fragen in den Bereichen Analytics, Big Data und Machine Learning bera ...
-
Engineer, Data
1周前
American Bureau of Shipping Shanghai, 中国 全职The Data Engineer analyzes complex and unstructured data using advanced data engineering techniques to develop and maintain data and deployment pipelines. This role uses knowledge of data processing, prototyping, and architecture methods to help solve real-world problems. The Dat ...
-
Avanade Shanghai, 中国Our talented Data Engineering team is made up of globally recognized experts - and there's room for more analytical and ambitious data professionals. If you're passionate about helping clients make better data-driven decisions to tackle their most complex business issues, let's t ...
-
Optiver Shanghai, 中国WHO WE ARE · Optiver is a global market maker with offices in Amsterdam, London, Chicago, Austin, Sydney, Shanghai, Hong Kong, Singapore and Taipei. Founded in 1986, today we are a leading liquidity provider, with close to 2,000 employees in offices around the world, united in o ...
-
Covestro Shanghai, 中国 全职Responsibilities: · Manage data access and improve data quality, particularly master data in the areas of research & development, product management, and sustainability. · Be responsible for data integration, data management solutions, and data quality. · Analyze business/project ...
-
Data Engineer III
1小时前
LexisNexis Shanghai, 中国 全职Job DescriptionAre you a champion for continuous improvement?Do you love collaborating with teams to solve complex technical problems in the field of employer-employee relations? · About our Team · LexisNexis Legal & Professional, which serves customers in more than 150 countries ...
-
Data Engineer III
5小时前
LexisNexis Shanghai, 中国 全职Are you a champion for continuous improvement?Do you love collaborating with teams to solve complex technical problems in the field of employer-employee relations? · About our Team · LexisNexis Legal & Professional, which serves customers in more than 150 countries with 11,300 em ...
-
Lead Data Engineer
17小时前
Eraneos Shanghai, 中国 全职What you will find with us · We are a technical, implementation-oriented spin-off of a global management consultancy. Our clients are primarily DAX and Fortune Global 500 companies, which we advise on issues in the areas of analytics, big data and machine learning. Within the gro ...
-
BASF SE SHANGHAI, 中国Objectives: · - To be part of a highly motivated and agile global team that develops innovative digital solutions for marketing and sales within the Global Automotive OEM Coatings business (G-ECO/MD). The transformation into a data driven business unit requires our data to be rea ...
-
Data Engineer Intern
1小时前
Ikea Shanghai, 中国 InternJob ID: CN · Date posted: 09/04/ · WHO YOU ARE · * Good interpersonal skills with the ability to collaborate, network, and build strong relations with team members and stakeholders · * Good knowledge of advanced data structures and distributed computing · * Good Knowledge of AI ...
-
Corning Shanghai, 中国Requisition Number: 62691 · Corning is vital to progress – in the industries we help shape and in the world we share. · We invent life-changing technologies using materials science. Our scientific and manufacturing expertise, boundless curiosity, and commitment to purposeful inve ...
-
Corning Shanghai, 中国Requisition Number: 62691 · Corning is vital to progress – in the industries we help shape and in the world we share. · We invent life-changing technologies using materials science. Our scientific and manufacturing expertise, boundless curiosity, and commitment to purposeful inve ...
-
Siemens Shanghai Medical Equipment Ltd. Shanghai, 中国 PermanentJoinus in pioneering breakthroughs in healthcare. For everyone. Everywhere.Sustainably. · Ourinspiring and caring environment forms a global community that celebratesdiversity and individuality. We encourage you to step beyond your comfort zone,offering resources and flexibility ...
-
NVIDIA Shanghai, 中国 全职NVIDIA is hiring distributed systems and structured data platform engineers to design and develop our exa-scale AI infrastructure and deep learning platform for Autonomous Vehicles. Together, we will build the exa-scale software 2.0 cloud platform for one of the most ambitious pr ...
-
Bloomberg Shanghai, 中国Senior Data Management Professional - Data Engineering - Equity Corporate Actions Data, Shanghai · Shanghai · Posted Apr 16, Requisition No · Bloomberg runs on data. Our products are fueled by powerful information. We combine data and context to paint the whole picture for our ...
-
NVIDIA Shanghai, 中国 全职NVIDIA is hiring distributed systems and data engineers to design and develop our exa-scale AI infrastructure for ingesting, indexing and managing data of Autonomous Vehicles. Together, we will build the exa-scale software 2.0 cloud platform for one of the most ambitious problems ...
-
Senior Manager, AI
1小时前
Porsche Engineering Group Shanghai, 中国TasksTasks · Lead the development and execution of AI strategies, including identifying opportunities for AI integration and leveraging AI technologies to drive business growth and innovation; main domains are data analysis, simulation, Generative Artificial Intelligence · Colla ...
-
Bosch Shanghai, 中国 全职Job Description · We are looking for an exceptional leader to head our research group in Shanghai and drive innovation in the exciting fields of flexible production, knowledge engineering, robotics, and AIGC for Industry And, we strive to "Easy connected production systems and ef ...
-
NVIDIA Shanghai, 中国 全职NVIDIA is hiring Senior Computer Vision Software Engineer to help develop its world-class AI Infrastructure and leading-edge software on NVIDIA's high-performance DRIVE platform for Autonomous Vehicles. We aim to build a high-efficient end-to-end data pipeline for ground truth pr ...
-
NVIDIA Shanghai, 中国 全职Intelligent machines powered by Artificial Intelligence computers that can learn, reason and interact with people are no longer science fiction. Today, a self-driving car powered by AI can meander through a country road at night and find its way. An AI-powered robot can learn mot ...
Senior Data Engineer - Shanghai, China, 中国 - Coins
描述
Join the Pioneer Crypto Brand in the Philippines
Coins is the most established crypto brand in The Philippines and has gained the trust of more than 18 million users. Through the easy-to-use mobile app, users can buy and sell a variety of different cryptocurrencies and access a wide range of financial services.
Coins is fully regulated by the Bangko Sentral ng Pilipinas (BSP) and is the first ever crypto-based company in Asia to hold both Virtual Currency and Electronic Money Issuer licenses from a central bank.
Responsibilities:
