Senior Azure AI Solutions Architect / Engineer
Govcio
Remote · Washington, DC · Posted August 18, 2026
Just laid off? Start here: a plan for the first weeks
More in District of Columbia job market · Technology & Software · Data & Analytics jobs
More roles at Govcio
- ServiceNow Workflow Manager · Hampton, VA
- Change Manager · Hampton, VA
- Business Analyst/Business Process Modeler (Remote)
- Sr. Technical Program Manager · Fort Meade, MD
- Automation Engineer · Atlanta, GA
- Principal Program Manager, Informatics (Remote)
Similar jobs
- Senior Remote Tower Systems Engineer · Chickasaw Nation Medical Center · Washington, DC
- Solution Architect – ServiceNow & Enterprise Applications · Caci, Inc. - Federal
- Senior Platform Engineer · Baker Tilly · CA
- Principal Platform Engineer - Integrations · Baker Tilly · CA
- Sr. Specialist, Integration & Test Engineer (Reliability & Maintainability) · L3HARRIS Technologies · Greenville, TX
- Senior Associate, Systems Engineer · L3HARRIS Technologies · Carlsbad, CA
Where Washington, DC ranks
Where Washington, DC placed in our monthly rankings, month by month. Each month stays online at its own address.
November 2026
- #1Cities hosting the most business conferences in the Mid-Atlantic104 conferences · of 12
- #1Cities hosting the most government & public sector conferences18 conferences · of 29
- #1Cities hosting the most accounting & audit conferences8 conferences · of 14
- #1Cities hosting the most finance conferences9 conferences · of 24
- #1Cities hosting the most legal conferences10 conferences · of 10
- #2Best cities for sales pay after cost of living$169k · of 45
Rankings about data & analytics jobs
- Best cities for data and analytics jobs #1 New York (1,713 openings)
- Best cities for data and analytics pay after cost of living #1 Foster ($232k)
- Most requested AI skills in data and analytics jobs #1 Machine learning engineering (17.1%)
- AI tools named most often in data and analytics jobs #1 Databricks (7.6%)
- Employers with the most data and analytics jobs #1 Amazon (711 roles)
Data & Analytics jobs · Top Data & Analytics employers · All rankings
How AI is used in this kind of work
Among computer occupations, all other, AI is already used for a large share of the tasks. Measured exposure for computer occupations, all other: 31% (high).
Share of this job’s tasks that AI is already used for at work, from real usage. It is not a forecast of job loss, and a low number means no use seen yet. Source: Anthropic Economic Index.
Skills this job asks for
Say which you have and which you want to build. We use it to match you to jobs like this one.
About the job
GovCIO is currently hiring for a highly experienced, hands-on Senior Azure AI Solutions Architect / Engineer to lead the architecture, development, and implementation of enterprise Generative AI and intelligent document solutions within a complex federal application environment.
This individual will serve as a technical leader for the adoption of Microsoft Azure AI capabilities, working alongside existing application architects, developers, infrastructure teams, and subject matter experts to introduce secure, scalable AI capabilities into established enterprise systems.
Initial efforts will focus on AI-assisted document intelligence, enterprise search and retrieval, Retrieval-Augmented Generation (RAG), document summarization, structured data extraction, document classification, and AI-assisted business process automation.
The successful candidate must be equally comfortable designing the architecture and building the solution. This is not solely an advisory or strategy position. The individual will be expected to configure Azure AI services, develop prototypes and production solutions, integrate with existing applications and data repositories, troubleshoot technical challenges, establish AI development patterns, and transfer knowledge to existing technical teams.
The position is remote and supports a federal customer in the Washington, D.C. metropolitan area.
Responsibilities
Lead the architecture, design, development, and implementation of enterprise Generative AI solutions using the Microsoft Azure AI ecosystem.
Design and implement solutions using Microsoft Foundry, Azure OpenAI/model services, Azure AI Search, Azure AI Document Intelligence , and related Azure capabilities.
Architect and implement Retrieval-Augmented Generation (RAG) solutions over enterprise structured and unstructured data.
Develop AI-assisted enterprise search capabilities capable of identifying relevant documents, pages, data elements, and supporting evidence across large document repositories.
Develop capabilities for natural-language question answering, document summarization, information extraction, structured output generation, and AI-assisted research.
Design and implement semantic, vector, hybrid, and agentic retrieval approaches as appropriate for specific business requirements.
Develop secure integration patterns between Azure AI services and existing enterprise applications, APIs, databases, and document repositories.
Integrate AI functionality into existing enterprise applications through REST APIs, SDKs, Java services, and other approved integration patterns.
Evaluate and implement Azure AI Document Intelligence capabilities for document classification, metadata/data extraction, confidence scoring, and exception handling.
Design AI agents and orchestration workflows using Microsoft Foundry capabilities when appropriate.
Partner with existing application, IBM FileNet and IBM DataCap technical teams to introduce AI capabilities while leveraging existing enterprise platforms and investments.
Design solutions that preserve application-level authorization and ensure users only receive AI-generated information derived from data they are authorized to access.
Implement appropriate Azure identity, access management, secrets management, networking, logging, monitoring, and security controls.
Establish AI evaluation and testing frameworks measuring retrieval accuracy, extraction accuracy, groundedness, hallucination rates, confidence, latency, performance, and business outcomes.
Develop and execute technical proofs of concept and MVPs and transition successful capabilities into secure, scalable production implementations.
Work with business and technical stakeholders to translate business processes and pain points into actionable AI solutions.
Evaluate alternative AI technologies and integration approaches and provide technical recommendations based on feasibility, security, cost, scalability, and business value.
Establish reusable architecture patterns, development standards, and technical documentation for future enterprise AI implementations.
Mentor existing architects and developers on Azure AI, RAG, LLM integration, prompt engineering, evaluation, and responsible AI development.
Provide hands-on knowledge transfer so that successful AI capabilities can ultimately be maintained and expanded by the existing technical organization.
Qualifications
Required Education and Experience
Bachelor's degree in Computer Science, Software Engineering, Information Systems, Data Science, Artificial Intelligence, Engineering, or a related technical discipline with 12 years (or commensurate experience.
Clearance Level: Public Trust
Required Skills & Experience
8+ years of progressive experience designing, developing, and implementing enterprise software, cloud, or data solutions.
5+ years of experience serving in senior engineering, technical architecture, cloud architecture, or comparable solution-design roles.
3+ years of hands-on experience designing or implementing AI/ML solutions.
2+ years of recent hands-on experience designing and implementing Generative AI, LLM, and/or RAG-based applications.
Demonstrated hands-on experience with the Microsoft Azure AI ecosystem, including Microsoft Foundry/Azure AI Foundry and Azure-hosted foundation models.
Demonstrated experience designing and implementing RAG architectures using enterprise data.
Hands-on experience with Azure AI Search or comparable enterprise semantic/vector search technologies.
Strong understanding of: Vector embeddings and vector databases/search
Semantic and hybrid search
Chunking and document-processing strategies
Prompt engineering and context management
Grounding and citation/source attribution
LLM orchestration
AI evaluation and hallucination mitigation
Experience integrating LLMs and AI services with enterprise data sources and applications.
Experience designing and implementing secure REST API and SDK-based integrations.
Experience with Python and/or Java for enterprise AI/application development.
Experience with Microsoft Azure architecture, including Entra ID, RBAC, managed identities, Key Vault, networking, storage, monitoring, and logging.
Demonstrated ability to design solutions involving sensitive or restricted enterprise information with appropriate data isolation and authorization controls.
Demonstrated experience taking at least one enterprise AI/ML solution from architecture or proof-of-concept through production deployment.
Experience establishing technical architecture while remaining directly involved in hands-on development and troubleshooting.
Demonstrated ability to communicate complex AI architecture and technical concepts to both technical and non-technical stakeholders.
Experience mentoring developers and transferring technical knowledge to existing engineering teams.
Preferred Skills & Experience
Candidates located in the DC area are highly preferred
Hands-on experience with Azure AI Document Intelligence, including document classification, custom extraction, structured data extraction, confidence scoring, and exception processing.
Experience building enterprise document intelligence, document search, or knowledge retrieval solutions involving large volumes of unstructured content.
Experience integrating AI solutions with enterprise content-management systems such as IBM FileNet.
Experience with IBM DataCap or comparable enterprise document capture and processing platforms.
Experience integrating AI functionality into existing Java-based enterprise applications.
Experience with Microsoft Foundry Agent Service and agentic AI architectures.
Experience with Microsoft Copilot Studio, including agents, connectors, actions, and enterprise workflow integration.
Experience with Azure DevOps, Git, CI/CD, Infrastructure as Code, and DevSecOps practices for AI-enabled applications.
Experience implementing AI evaluation frameworks and automated testing for production LLM applications.
Experience with document-level/page-level citations, source attribution, and explainable/traceable AI responses.
Experience implementing human-in-the-loop workflows and confidence-based exception routing.
Knowledge of responsible AI principles, model governance, data privacy, and AI risk management.
Experience working with PII, financial, benefits, healthcare, or other regulated/sensitive information.
Experience delivering solutions within federal government environments, including familiarity with FedRAMP, NIST controls, FISMA, ATO processes, and federal security requirements.
Experience evaluating AI platforms, models, and services based on cost, performance, security, accuracy, and operational suitability.
Experience with IBM watsonx or other enterprise AI platforms is beneficial but not required.
#dl #rt #tk, #tmk #ar
Posted Salary Range
USD $180,000.00 - USD $220,000.00 /Yr.
Lead the architecture, design, development, and implementation of enterprise Generative AI solutions using the Microsoft Azure AI ecosystem.
Design and implement solutions using Microsoft Foundry, Azure OpenAI/model services, Azure AI Search, Azure AI Document Intelligence , and related Azure capabilities.
Architect and implement Retrieval-Augmented Generation (RAG) solutions over enterprise structured and unstructured data.
Develop AI-assisted enterprise search capabilities capable of identifying relevant documents, pages, data elements, and supporting evidence across large document repositories.
Develop capabilities for natural-language question answering, document summarization, information extraction, structured output generation, and AI-assisted research.
Design and implement semantic, vector, hybrid, and agentic retrieval approaches as appropriate for specific business requirements.
Develop secure integration patterns between Azure AI services and existing enterprise applications, APIs, databases, and document repositories.
Integrate AI functionality into existing enterprise applications through REST APIs, SDKs, Java services, and other approved integration patterns.
Evaluate and implement Azure AI Document Intelligence capabilities for document classification, metadata/data extraction, confidence scoring, and exception handling.
Design AI agents and orchestration workflows using Microsoft Foundry capabilities when appropriate.
Partner with existing application, IBM FileNet and IBM DataCap technical teams to introduce AI capabilities while leveraging existing enterprise platforms and investments.
Design solutions that preserve application-level authorization and ensure users only receive AI-generated information derived from data they are authorized to access.
Implement appropriate Azure identity, access management, secrets management, networking, logging, monitoring, and security controls.
Establish AI evaluation and testing frameworks measuring retrieval accuracy, extraction accuracy, groundedness, hallucination rates, confidence, latency, performance, and business outcomes.
Develop and execute technical proofs of concept and MVPs and transition successful capabilities into secure, scalable production implementations.
Work with business and technical stakeholders to translate business processes and pain points into actionable AI solutions.
Evaluate alternative AI technologies and integration approaches and provide technical recommendations based on feasibility, security, cost, scalability, and business value.
Establish reusable architecture patterns, development standards, and technical documentation for future enterprise AI implementations.
Mentor existing architects and developers on Azure AI, RAG, LLM integration, prompt engineering, evaluation, and responsible AI development.
Provide hands-on knowledge transfer so that successful AI capabilities can ultimately be maintained and expanded by the existing technical organization.
Required Education and Experience
Bachelor's degree in Computer Science, Software Engineering, Information Systems, Data Science, Artificial Intelligence, Engineering, or a related technical discipline with 12 years (or commensurate experience.
Clearance Level: Public Trust
Required Skills & Experience
8+ years of progressive experience designing, developing, and implementing enterprise software, cloud, or data solutions.
5+ years of experience serving in senior engineering, technical architecture, cloud architecture, or comparable solution-design roles.
3+ years of hands-on experience designing or implementing AI/ML solutions.
2+ years of recent hands-on experience designing and implementing Generative AI, LLM, and/or RAG-based applications.
Demonstrated hands-on experience with the Microsoft Azure AI ecosystem, including Microsoft Foundry/Azure AI Foundry and Azure-hosted foundation models.
Demonstrated experience designing and implementing RAG architectures using enterprise data.
Hands-on experience with Azure AI Search or comparable enterprise semantic/vector search technologies.
Strong understanding of: Vector embeddings and vector databases/search
Semantic and hybrid search
Chunking and document-processing strategies
Prompt engineering and context management
Grounding and citation/source attribution
LLM orchestration
AI evaluation and hallucination mitigation
Experience integrating LLMs and AI services with enterprise data sources and applications.
Experience designing and implementing secure REST API and SDK-based integrations.
Experience with Python and/or Java for enterprise AI/application development.
Experience with Microsoft Azure architecture, including Entra ID, RBAC, managed identities, Key Vault, networking, storage, monitoring, and logging.
Demonstrated ability to design solutions involving sensitive or restricted enterprise information with appropriate data isolation and authorization controls.
Demonstrated experience taking at least one enterprise AI/ML solution from architecture or proof-of-concept through production deployment.
Experience establishing technical architecture while remaining directly involved in hands-on development and troubleshooting.
Demonstrated ability to communicate complex AI architecture and technical concepts to both technical and non-technical stakeholders.
Experience mentoring developers and transferring technical knowledge to existing engineering teams.
Preferred Skills & Experience
Candidates located in the DC area are highly preferred
Hands-on experience with Azure AI Document Intelligence, including document classification, custom extraction, structured data extraction, confidence scoring, and exception processing.
Experience building enterprise document intelligence, document search, or knowledge retrieval solutions involving large volumes of unstructured content.
Experience integrating AI solutions with enterprise content-management systems such as IBM FileNet.
Experience with IBM DataCap or comparable enterprise document capture and processing platforms.
Experience integrating AI functionality into existing Java-based enterprise applications.
Experience with Microsoft Foundry Agent Service and agentic AI architectures.
Experience with Microsoft Copilot Studio, including agents, connectors, actions, and enterprise workflow integration.
Experience with Azure DevOps, Git, CI/CD, Infrastructure as Code, and DevSecOps practices for AI-enabled applications.
Experience implementing AI evaluation frameworks and automated testing for production LLM applications.
Experience with document-level/page-level citations, source attribution, and explainable/traceable AI responses.
Experience implementing human-in-the-loop workflows and confidence-based exception routing.
Knowledge of responsible AI principles, model governance, data privacy, and AI risk management.
Experience working with PII, financial, benefits, healthcare, or other regulated/sensitive information.
Experience delivering solutions within federal government environments, including familiarity with FedRAMP, NIST controls, FISMA, ATO processes, and federal security requirements.
Experience evaluating AI platforms, models, and services based on cost, performance, security, accuracy, and operational suitability.
Experience with IBM watsonx or other enterprise AI platforms is beneficial but not required.
#dl #rt #tk, #tmk #ar