- Evaluation Strategy & Planning: Define and establish comprehensive evaluation strategies for new AI Agents. Prioritize the integrity and coverage of test data sets to reflect real-world usage and potential failure modes
- LLM Output Integrity Assessment: Programmatically and manually evaluate the quality of LLM-generated content against predefined metrics (e.g., factual accuracy, contextual relevance, coherence, and safety standards)
- Creating High-Fidelity Datasets: Design, curate, and generate diverse, high-quality test data sets, including challenging prompts and scenarios. Evaluate LLM outputs to proactively identify system biases, unsafe content, hallucinations, and critical edge cases
- Automation of Evaluation Pipelines: Develop, implement, and maintain scalable automated evaluations to ensure efficient, continuous validation of agent behavior and prevent regressions with new features and model updates
- Root Cause Analysis: Understand model behaviors and assist in the trace and root-cause analysis of identified defects or performance degradations
- Reporting & Performance Metrics: Clearly document, track, and communicate performance metrics, validation results, and bug status to the broader development and product teams
- Data Integrity & Validation: A strong, specialized understanding of data quality principles, including methods for validating datasets against bias, integrity concerns, and quality standards. Ability to craft diverse and adversarial test data to uncover AI edge cases
- Prompt Engineering & Model Expertise: Demonstrated skill in advanced prompt engineering techniques to create evaluation scenarios that test the AI's reasoning, action planning, and adherence to system instructions. Deep knowledge of LLM common failure modes (hallucination, incoherence, jailbreaking)
- Automated Evaluation Implementation: Proficiency in designing and deploying automated evaluation pipelines to assess complex, agentic AI behaviors. Familiarity with quality metrics such as task success rate, semantic similarity, and sentiment analysis for output measurement
- Debugging Agentic Systems: Must be comfortable with the specific challenges of debugging agentic systems, including tracing and interpreting an agent's internal reasoning, tool use, and action sequence to pinpoint failure points
- Programming & Frameworks: Proficiency in Python for developing custom evaluation frameworks, writing scripts, and integrating pipelines with CI/CD systems. Familiarity with standard test automation tools (e.g., Pytest, modern web automation tools)
- Bachelor's degree in Data Science, Machine Learning, Computer Science, or a related field, with experience in Gen AI / LLMs
- High work ethic. Veeva is a hard-working company
- High integrity and honesty. Veeva is a PBC and a “do the right thing” company. We expect that from all employees
- Applicants must have the unrestricted right to work in the United States or Canada. Veeva will not provide sponsorship at this time
- Medical, dental, vision, and basic life insurance
- PTO and company-paid holidays
- Retirement programs
- 1% charitable giving program
- Base pay: $85,000 - $225,000 CAD
- The salary range listed here has been provided to comply with local regulations and represents a potential base salary range for this role. Please note that actual salaries may vary within the range above or below, depending on experience and location. We look at compensation for each individual and base our offer on your unique qualifications, experience, and expected contributions. This position may also be eligible for other types of compensation in addition to base salary, such as variable bonus and/or stock bonus.
Work Where It’s Best for You
Work Anywhere means you can work in an office or at home on any given day. It’s about getting the work done in the way and place that works best for each person. This applies across all locations and departments.
Work Anywhere does not mean work at any time. We have predictable core hours where employees are generally available for meetings and collaboration. Employees are focused and available during core hours.
We invest in our offices to make them places where our employees like to go. If you work in the office three or more days a week, you will have a dedicated office workspace. Our offices function as hubs to draw people in, create social bonds, and where random connections and mixing of ideas happen. We’re investing more in offices, culture, and offsite meetings, not less.
Product teams are organized in regional product hubs for optimal collaboration and live within a time zone of their hub. Our current product hubs are located in Pleasanton, Columbus, Boston, Kansas City, New York City, Raleigh, and Toronto. We create opportunities for teams to get together in person regularly.
Customer-facing roles, such as Sales and Professional Services, live near and/or travel to their customers.
When an employee moves within a country it does not cause a change in salary. Where you live impacts you and your family. Not knowing if your compensation will change if you move can cause stress and uncertainty for everyone. We wanted to eliminate that.
Work at Veeva. Work where it’s best for you.
A different kind of company. A Public Benefit Corporation.
Unlike a traditional corporation, whose only legal duty is to maximize shareholder value, PBCs consider their public benefit purpose and the interests of those materially affected by the corporation’s conduct—including customers, employees, and the community—in addition to shareholders’ interests.
What sets us apart
In February 2021, Veeva became the first public company to convert to a Public Benefit Corporation (PBC).
Unlike a traditional corporation, whose only legal duty is to maximize shareholder value, PBCs consider their public benefit purpose and the interests of those materially affected by the corporation’s conduct—including customers, employees, and the community—in addition to shareholders’ interests.
Veeva’s public benefit purpose is to help make the industries we serve more productive and create high-quality employment opportunities.
Work Anywhere means you can work in an office or at home on any given day. It’s about getting the work done in the way and place that works best for you.
We invest in our offices to make them places where our employees like to go. If you work in the office three or more days a week, you will have a dedicated office workspace.
Product teams are organized in regional product excellence hubs for optimal collaboration and live within a time zone of their hub. Our current product hubs are located in Pleasanton, Columbus, Boston, Kansas City, New York City, Raleigh, and Toronto. We create opportunities for teams to get together in person regularly.
Customer-facing roles, such as Sales and Professional Services, live near and/or travel to their customers.
At Veeva, we believe in giving back. Veeva’s support for charitable causes is entirely employee driven because we think giving is personal and should be directed by the individual. With our 1% Veeva Giving program, each employee receives an amount equivalent to 1% of their base salary annually to support the non-profit(s) of their choice. We don’t dictate favored corporate causes or ask employees to donate to specific non-profits. We never support a charitable cause in exchange for commercial advantage or preferential treatment.
Veeva’s core values — do the right thing, customer success, employee success, and speed — guide our decision making and define our culture. Doing the right thing means that we are concerned about more than just financial success and return to shareholders. We recognize a responsibility to customers, employees, environment, and society.As individuals, we pride ourselves on being good people who are honest, fair, and direct. We treat others with respect. As a company, we strive to be a good corporate citizen, a positive force in the business community, active in our communities, and an example to others.
Our equity program is designed to enable the vast majority of our employees to participate. Our unique approach to awarding equity grants allows our employees to be shareholders so they can benefit financially in the company’s growth.
Veeva has taken a strong stance against the use of non-compete agreements that can limit employee opportunities. We do not require our employees to sign non-compete agreements, and we have taken legal action to fight the unfair use of these agreements by other companies because we believe such agreements limit an employee’s fundamental right to work where they choose. We believe in our people and want them to be successful here at Veeva or wherever their careers take them.
News and recognition
Grow, contribute and be recognized
“Veeva’s engineering teams take a pragmatic approach to software development. We offer an ideal environment for engineers who value focus, speed and integrity in their work.”
—Jacob Marcus
VP, Engineering
“I appreciate that Veeva values autonomy over alignment. As a result, we get to make decisions as a small team and ship products faster.”
—Shilpa Chandermohan
Software Engineer
“As a software engineer at Veeva, I’m proud to be doing meaningful work building clinical trial software that will benefit so many people.”
—Durward Denham
Software Engineer