Case Studies: Cybersecurity
Automating Vendor Questionnaires
Problem
Slow process to evaluate & assess 3rd party cyber risks in lengthy questionnaires
Solution
Two domain-specific LLMs working in tandem to classify, evaluate, and flag vendor responses
Results
- 33% reduction in manual review time
- 27% increase in accuracy
Innovate or Stagnate
Real Results
Our cybersecurity client needed a more efficient way for its analysts to streamline the review of lengthy cybersecurity questionnaires and documents to ensure 3rd party vendors met industry best practices and standards for their customers.
APPROACH
We developed two custom LLMs, using open source models trained on proprietary data and supplemented with NIST standards. We fine-tuned and trained a domain classifier, providing a diagnostic UI for expert feedback to refine accuracy. We then trained and deployed an LLM to evaluate and flag vendor-submitted responses.
RESULT
The custom semantic search and evaluation solution reduced manual document review by 33%, significantly improving analyst efficiency and expediting the review process. It also resulted in a 27% improvement in flagging potential risks.
Proven Expertise
The Rotational Difference
Tailored AI Solutions
We create customized AI/ML systems that directly address your business needs, ensuring impactful, scalable results.
Proven Expertise
We know how to train, deploy, and maintain AI solutions that maximize efficiency and ROI.
Sensible Tech
We use sensible, proven tech that delivers business value while ensuring your systems are future-proof for evolving needs.
End-to-End Support
From R&D to deployment and monitoring, we provide comprehensive services that ensure long-term success.
Security & Control
Your data stays within your environment—no third parties involved—ensuring full control and compliance.
Operational Impact
We focus on measurable outcomes that save costs, generate growth, or improve productivity for lasting business value.