Domain Expert Lead- Stem

OverviewJob ID: ******* | Amazon.com Services LLCThis is a 12 month contract opportunity with the possibility to extend based on business needs.Embark on a transformative journey as our Domain Expert Lead, where intellectual rigor meets cutting-edge technological innovation.In this pivotal role, you will serve as a strategic architect of data integrity, leveraging your domain expertise to advance AI model training and evaluation.Your domain knowledge and experience will be instrumental in elevating our artificial intelligence capabilities, meticulously refining data collection processes and ensuring the highest standards of quality and precision across complex computational landscapes.ResponsibilitiesCritically analyze and evaluate responses generated by our LLMs across various domains and use cases in your area of expertise.Develop and write demonstrations to illustrate "what good data looks like" in terms of meeting benchmarks for quality and efficiency.Participate in the creation of tooling that helps create such data by providing your feedback on what works and what doesn't.Champion effective knowledge-sharing initiatives by translating domain expertise into actionable insights, while cultivating strategic partnerships across multidisciplinary teams.Provide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and output.Collaborate with the AI research team to identify areas for improvement in the LLM's capabilities.Stay abreast of the latest developments in how LLMs and GenAI can be applied to your area of expertise to ensure our evaluations remain cutting-edge.Basic Qualifications1+ years of data querying languages (e.g. SQL), scripting languages (e.g. Python) or statistical/mathematical software (e.g. R, SAS, Matlab, etc.) experience2+ years of data/research scientist, statistician or quantitative analyst in an internet-based company with complex and big data sources experience1+ years of creating or contributing to mathematical textbooks, research papers, or educational content experienceMaster's degree in Science, Technology, Engineering, or Mathematics (STEM), or experience working in Science, Technology, Engineering, or Mathematics (STEM)Preferred QualificationsPh.D. in Science, Technology, Engineering, or Mathematics (STEM)Knowledge of statistical packages and business intelligence tools such as SPSS, SAS, S-PLUS, or RKnowledge of machine learning concepts and their application to reasoning and problem-solvingExperience with clustered data processing (e.g., Hadoop, Spark, Map-reduce, and Hive)Experience working with or evaluating AI systemsExperience applying quantitative analysis to solve business problems and making data-driven business decisionsExperience effectively communicating complex concepts through written and verbal communicationAmazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.Our inclusive culture empowers Amazonians to deliver the best results for our customers.If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information.If the country/region you're applying in isn't listed, please contact your Recruiting Partner.Our compensation reflects the cost of labor across several US geographic markets.The base pay for this position ranges from $97,500/year in our lowest geographic market up to $185,000/year in our highest geographic market.Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience.Amazon is a total compensation company.Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits.For more information, please visit .This position will remain posted until filled.Applicants should apply via our internal or external career site.Based on your recent activity, you may be interested in:Posted:October 17, **** (Updated about 1 month ago)Posted:July 17, **** (Updated 6 months ago)Posted:July 24, **** (Updated 8 days ago)Posted:November 25, **** (Updated 29 days ago)Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.#J-*****-Ljbffr