Senior Data Engineer

Hitachi Digital Services
United States, Pennsylvania, Reading
Jan 26, 2026
Our Company We're Hitachi Digital Services, a global digital solutions and transformation business with a bold vision of our world's potential. We're people-centric and here to power good.Every day, we future-proof urban spaces, conserve natural resources, protect rainforests, and save lives. This is a world where innovation, technology, and deep expertise come together to take our companyand customers from what's now to what's next.We make it happen through the power of acceleration. Imagine the sheer breadth of talent it takes to bring a better tomorrow closer to today. We don't expect you to 'fit' every requirement - your life experience, character, perspective, and passion for achieving great things in the world are equally as important to us. Location: Reading, PA (Hybrid) The Team You will join a high-impact Cloud Data & Modernization team driving large-scale enterprise transformation initiatives. The team partners with business, architecture, and engineering stakeholders to modernize legacy data platforms into scalable, cloud-native ecosystems built on AWS, Spark-based processing, and microservices-driven architectures. We focus on delivering secure, high-performance, and governed data solutions that enable analytics, AI/ML, and real-time business insights. The Role Data Migration & Modernization Lead large-scale data migrations from Oracle, SQL Server, Teradata, and legacy platforms to modern cloud data platforms (primarily AWS). Define and execute migration strategies including one-time migrations, CDC/incremental loads, and near zero-downtime cutovers. Architect Spark-based transformation frameworks for scalable batch and real-time data processing. Validate outcomes through reconciliation, profiling, and robust data quality checks. Cloud-Native Architecture (AWS & Microservices) Design and implement cloud-native data pipelines leveraging AWS services such as S3, Redshift, RDS, Glue, Lambda, EMR, and event-driven architectures. Develop microservices-based data integration patterns using REST APIs, message queues (Kafka/SQS/SNS), and containerized workloads. Enable Spark-based distributed processing (PySpark/Scala Spark) for high-volume data transformations. Ensure alignment with enterprise security, IAM, encryption, and compliance standards. Governance, Quality & Compliance Implement data quality rules, validation frameworks, and exception handling mechanisms. Enforce metadata management, lineage tracking, and data catalog integration. Support regulatory and compliance requirements (GDPR, SOX, HIPAA as applicable). Align solutions with enterprise data governance frameworks. DevOps & Automation Integrate data pipelines into CI/CD frameworks for automated build, test, and deployment cycles. Enable automated testing (unit, regression, and data validation testing). Manage version control, containerization, environment promotion, and release management. Implement proactive monitoring, logging, and production stability mechanisms. Stakeholder & Technical Leadership Lead and mentor data engineers and developers across Spark and cloud technologies. Translate business requirements into scalable, cloud-native technical designs. Contribute to architecture reviews and executive-level technical discussions. What You'll Bring Strong experience leading enterprise data migrations and modernization programs, including CDC and near-zero downtime strategies. Hands-on expertise with Apache Spark (PySpark/Scala), distributed data processing, and performance optimization. Deep knowledge of AWS data ecosystem (S3, Redshift, EMR, Glue, Lambda, IAM, etc.). Experience designing microservices-based architectures, API-driven integrations, and event-based data processing. Solid grounding in data governance, metadata management, lineage, and data quality frameworks. Experience implementing DevOps for data platforms (CI/CD, automation, version control, containerization). Strong leadership skills with the ability to mentor engineers and communicate effectively with both technical and business stakeholders. About us We're a global, team of innovators. Together, we harness engineering excellence and passion to co-create meaningful solutions to complex challenges. We turn organizations into data-driven leaders that can make a positive impact on their industries and society. If you believe that innovation can bring a better tomorrow closer to today, this is the place for you. #LI-RS2 Fostering innovation through diverse perspectives Hitachi is a global company operating across a wide range of industries and regions. One of the things that sets Hitachi apart is the diversity of our business and people, which drives our innovation and growth. We are committed to building an inclusive culture based on mutual respect and merit-based systems. We believe that when people feel valued, heard, and safe to express themselves, they do their best work. How we look after you We help take care of your today and tomorrow with industry-leading benefits, support, and services that look after your holistic health and wellbeing. We're also champions of life balance and offer flexible arrangements that work for you (role and location dependent). We're always looking for new ways of working that bring out our best, which leads to unexpected ideas. So here, you'll experience a sense of belonging, and discover autonomy, freedom, and ownership as you work alongside talented people you enjoy sharing knowledge with. We're proud to say we're an equal opportunity employer and welcome all applicants for employment without attention to race, colour, religion, sex, sexual orientation, gender identity, national origin, veteran, age, disability status or any other protected characteristic.Should you need reasonable accommodations during the recruitment process, please let us know so that we can do our best to set you up for success.