AI Quality Analyst & Language Specialist
Piotr
Niesłuchowski
human edge
Bringing linguistic judgment and human perspective to AI quality – from output evaluation and safety review to RLHF, annotation QA, and multilingual content assessment for global teams.
Overview
Professional Profile
I am an AI-focused language and quality specialist with extensive experience in AI data annotation, content evaluation, bias category review, and failure mode identification. My background spans evaluating AI-generated content for language quality and safety categories, combined with deep expertise in content localization, linguistic QA, and terminology management.
I excel at applying structured judgment, maintaining consistency, identifying quality issues, and improving content workflows across language, brand, and user-experience dimensions. I thrive in cross-functional, international teams and have collaborated with stakeholders across the US, Denmark, Malaysia, Taiwan, and many other markets worldwide.
Navigating cultural nuance is central to my approach – whether evaluating AI outputs for Polish and English audiences or ensuring global content resonates across markets.
Education
MA in Translatorics
University of Warsaw
2008 – 2013
Thesis: “The Link Between the Goal of Translating Song Lyrics and the Relevant Translation Strategies Adopted”
Location
Poland & Morocco
Remote-first professional
Global collaboration experience
Focus
AI Quality Assurance
Localization & Linguistics
Data Annotation & Evaluation
Languages
Polish — Native
English — Proficient (C2)
Multilingual QA expertise
Career Path
Work Experience
AI Language Specialist | Annotator & Peer Reviewer
- Evaluated and annotated AI-generated content for accuracy, fluency, cultural alignment, and safety (harmfulness, bias), feeding RLHF and human-in-the-loop pipelines; promoted to Reviewer for consistently high task quality.
- Designed AI agent test scenarios in fully simulated environments (Gmail, Notes, Google Drive) with realistic personas and data, targeting agent reasoning, filtering, and prioritization; promoted to Writer Lead for consistently high task quality.
- Applied structured judgment to assess output quality, policy compliance, safety risk, and linguistic appropriateness; ran adversarial prompt generation and failure-mode analysis.
- Reviewed and assessed voice models for customer service applications, evaluating naturalness, accuracy, and conversational flow, and providing detailed feedback to guide model training; tasks also included transcription auditing and peer review of team members’ conversations.
- Performed temporal video annotation and quality review, labeling language-spoken segments across multi-speaker video content as part of a structured team annotation pipeline.
- Developed guidelines and documentation to improve consistency in AI outputs; collaborated with researchers to identify language-specific challenges and edge cases.
- Provided expert feedback on grammar, semantics, style, and tone; proposed data quality improvements and refinements to linguistic annotation guidelines.
Senior Language Specialist
- Created and adapted HR and branding content for global markets, ensuring clarity, inclusiveness, and audience fit.
- Reviewed and edited job adverts and adapted them to different markets and cultures, focusing on diverse and inclusive language use.
- Provided guidance to hiring managers on which unique selling points to highlight.
- Collaborated with international stakeholders across the US, Denmark, Malaysia, and Taiwan.
- Trained new team members and interns, supporting onboarding and quality consistency.
Language Specialist
- Led end-to-end Polish localization for product launches and marketing campaigns across B2B and B2C channels.
- Maintained the quality of the Polish version of Booking.com, incl. website checks and maintaining language-specific tools, such as glossaries and style guides.
- Conducted post-editing and quality checks for machine-translated content, managing style guides, glossaries, and translation memories.
- Improved workflows, tested new tools, and shared insights from localization audits and competitor analysis.
- Managed and supported freelancers, evaluated and monitored the quality of their translations, provided them with consistent and regular feedback.
Senior Content Manager
- Wrote and edited deal content for the US site, maintaining brand tone and clarity standards.
- Provided translations for the HR department and Communications team.
- Ensured attractiveness, coherence, and clarity of the Groupon.com website.
Expertise
Skills & Competencies
From platform tooling to evaluation frameworks to cross-cultural deployment, I work across the full annotation pipeline, turning raw data into high-quality, deployment-ready training sets.
Annotation & Evaluation
Annotation Platforms
Localization & QA
CAT Tools & Tech
Creative & Personal
Let’s Connect
Get in Touch
Open to AI quality, localization strategy, prompt evaluation, and conversational AI evaluation roles. Available for remote collaboration worldwide.