AI Software Engineer

Job Description

What Will You Do?

Engineering & Delivery 

• Design and implement backend systems and APIs that integrate LLMs, vector databases, and retrieval components 

• Build, deploy, and maintain RAG pipelines and AI agents in production 

• Write clean, testable, maintainable code following engineering best practices 

• Contribute to CI/CD pipelines, testing, and observability of AI systems 

• Optimize AI components for performance, reliability, and correctness 

Collaboration 

• Translate requirements into working software alongside senior engineers, product managers, and domain experts 

• Participate in Agile ceremonies, sprint planning, and code reviews 

• Communicate technical progress, risks, and trade-offs clearly within the team 

Qualifications, Skills & Experience

Required

• Proven software engineering experience — strong, production-level Python is essential 

• Experience building systems that integrate APIs, databases, and cloud services 

• Hands-on experience with LLMs, RAG architectures, vector databases, or generative AI applications 

• RESTful API development experience 

• Familiarity with CI/CD, testing practices, and software delivery 

Nice to Have

• AWS or other cloud provider experience 

• Containerization (Docker, Kubernetes) 

• Agile/Scrum background 

• Familiarity with prompt engineering or AI evaluation frameworks

• Bachelor's or Master's in Computer Science, Software Engineering, or a related technical discipline 

What We Offer

• Exciting work in a great team, global projects, international environment

• Opportunity to learn and grow professionally within the company globally

• Hybrid working model, flexible role pattern

• Pension and health (Canadian Medical) contributions

• Internal reward system plus referral program

• 5 weeks annual leave, 5 sick days, 15 days of certified sick leave paid above statutory requirements annually, 40 paid hours annually for volunteering activities, 12 weeks of parental contribution

• Cafeteria for tax free benefits according to your choice (meal vouchers, sport, culture, health, travel, etc.), Multisport card

• Vodafone, Raiffeisen Bank and Foodora discount programs

• Up-to-date laptop and iPhone

• Parking in the garage, showers, refreshments, massage chairs, library, music corner

• Competitive salary, incentive pay, and many more

Ready to take up the challenge? Apply now!
Know anybody who might be interested? Refer this job!

#joinAI

The date shown below is the earliest possible closing date for this posting. However, we sometimes extend the job posting period as needed, so please feel free to apply anytime you see the "Apply" button available. You may also reach out to the recruiter directly via https://www.linkedin.com/in/badumtss/

Required Skills:

AI Adoption, AI Frameworks, AI Integration, AI Programming, AI Prompting, AI Security, API Development, API Management, API Platforms, API Programming, API Testing, CI/CD, Cloud Computing, Large Language Models (LLMs), Machine Learning (ML), Programming Languages, Prompt Design, Prompt Engineering, Prompt Optimization

Preferred Skills:

Artificial Intelligence (AI), Computer Science, C Sharp (Programming Language), Python (Programming Language), Software Design, Structured Query Language (SQL)

Current Employees apply HERE

Current Contingent Workers apply HERE

Search Firm Representatives Please Read Carefully 
Merck & Co., Inc., Rahway, NJ, USA, also known as Merck Sharp & Dohme LLC, Rahway, NJ, USA, does not accept unsolicited assistance from search firms for employment opportunities. All CVs / resumes submitted by search firms to any employee at our company without a valid written search agreement in place for this position will be deemed the sole property of our company.  No fee will be paid in the event a candidate is hired by our company as a result of an agency referral where no pre-existing agreement is in place. Where agency agreements are in place, introductions are position specific. Please, no phone calls or emails. 

Employee Status:

Regular

Relocation:

No relocation

VISA Sponsorship:

Yes

Travel Requirements:

10%

Flexible Work Arrangements:

Hybrid

Shift:

Not Indicated

Valid Driving License:

No

Hazardous Material(s):

N/A

Job Posting End Date:

05/25/2026

*A job posting is effective until 11:59:59PM on the day BEFORE the listed job posting end date. Please ensure you apply to a job posting no later than the day BEFORE the job posting end date.

Global pharmaceutical company known for oncology, vaccines, and infectious disease treatments. Headquartered in Rahway, NJ.

merck.com