Roles & Responsibilities
Position Overview
We are seeking an experienced Business Analyst to support the development and implementation a comprehensive AI platform featuring third-party LLM integration, enterprise data source connectivity, and agentic orchestration capabilities. This role will be critical in translating complex business requirements into technical specifications for AWS Professional Services and ensuring successful delivery of this advanced AI platform.
Key Responsibilities
Magic Platform Requirements Analysis
- Lead requirements gathering workshops with up to define business objectives
- Analyse and document requirements for the three core components :
o Third-Party LLM Integration Framework (e.g. OpenAI, Gemini, WOG Maestro)
o Enterprise Data Source Integration with RAG pipeline (e.g. Sharepoint, Teams, JIRA, Confluence)
o Agent Orchestration System with autonomous task completion
Define functional requirements for enterprise data source integrations based on identified use casesSpecify requirements for up to agentic bots aligned with business scenariosEnterprise Data Integration Analysis
Analyse current enterprise systems and define secure connector requirementsDocument requirements for Backend ELT Pipeline processes and user-friendly frontend interfacesDefine secure data transfer workflows and data security implementation requirementsSpecify RAG pipeline requirements including query processing, retrieval mechanisms, and response generationAnalyse document processing needs for various formats and vector embedding requirementsAgent Orchestration & Automation
Define requirements for backend infrastructure supporting agent managementAnalyse workflow orchestration needs and tool integration requirementsDocument multi-step workflow automation requirements and autonomous task completion specificationsWork with stakeholders to identify connected data source requirementsDefine performance metrics and monitoring requirements for agent systemsAdministrative & Monitoring Requirements
Specify user management requirements including CRUD operations, role assignment, and access controlDefine bot configuration interface requirements and deployment controlsDocument data source management requirements including connection configuration and status monitoringAnalyse dashboard requirements for bot usage tracking, conversation metrics, and user engagementDefine custom metric requirements and reporting capabilitiesTesting & Quality Assurance
Define comprehensive test scenarios for bot functionality using Litmus or Moonshot frameworksSpecify requirements for LLM-as-a-Judge evaluation systemsDocument performance testing requirements including load testing and stress testing parametersDefine remediation support requirements for UAT and performance testing phasesAnalyse security testing requirements including VAPT and vulnerability assessment needsStakeholder Management & Communication
Facilitate coordination between client’s stakeholders and technical teamsSupport project management activities including sprint planning and milestone trackingParticipate in bi-weekly status reporting and stakeholder alignment meetingsManage expectations regarding deliverables, timelines, and technical constraintsSupport knowledge transfer training sessions for up to 5 participants per sessionRequirements
Educational Background
Bachelor's degree in Business Administration, Information Systems, Computer Science, or related fieldProfessional certifications in business analysis (CBAP, CCBA) or AI / ML technologies are advantageousProfessional Experience
4+ years of experience in business analysis for complex technology projectsMinimum 2 years of experience with AI / ML or LLM implementation projectsExperience in Talend is a must haveProven experience working with AWS cloud services and enterprise system integrationsExperience with government or public sector digital transformation projects preferredAI & Technical Expertise
Strong understanding of Large Language Models (LLMs) and their business applicationsKnowledge of RAG (Retrieval-Augmented Generation) architectures and vector databasesFamiliarity with AI governance frameworks and ethical AI considerationsUnderstanding of enterprise data integration patterns and API managementExperience with cloud platforms (AWS preferred) and containerisation technologiesKnowledge of AI safety testing frameworks and guardrail implementationsPlatform Specific Skills
Experience with multi-modal AI systems and agent orchestration conceptsUnderstanding of prompt engineering and chain-of-thought implementationsKnowledge of AI model evaluation metrics and performance optimizationFamiliarity with enterprise security requirements and compliance frameworksExperience with agile methodologies and MLOps practicesCore Competencies
Excellent workshop facilitation and stakeholder management skillsStrong analytical thinking and complex problem-solving abilitiesAbility to translate technical AI concepts for non-technical stakeholdersDetail-oriented approach to requirements documentation and traceabilityExperience with requirements management tools and agile project managementUnderstanding of government security clearance processes and information handling protocolsDesirable Experience
Knowledge of Singapore government digital services and WOG systemsFamiliarity with AI testing frameworks (Litmus, Moonshot, Sentinel)Experience with vector databases and embedding technologiesUnderstanding of enterprise data governance and privacy regulationsTell employers what skills you have
Management Skills
Requirements Gathering
UAT
Confluence
Quality Assurance
Business Analysis
Translating
Task Completion
Data Integration
Requirements Analysis
JIRA
Workshop Facilitation
Business Analyst
Orchestration
Stakeholder Management
Business Requirements
%20PTE.%20LTD.){kind=logo}