What is a high-risk AI system for fashion companies?
Under the EU AI Act, an AI system in a sensitive area, such as hiring or credit, that must meet strict requirements.
In short
Under the EU AI Act, a high-risk AI system is one used in a sensitive area, such as hiring, worker management or access to credit, that must meet strict requirements. Most fashion uses are not high-risk, but some HR and finance tools can be.
How does it work in practice?
Classification depends on the use case rather than on the technology itself. The same model could be low-risk when it tags product images and high-risk when it ranks job applicants. The Act lists the sensitive areas, and companies must check whether their tools fall into them.
High-risk systems must meet requirements including:
- A documented risk management process.
- Quality, relevant and representative training data.
- Technical documentation and record keeping.
- Effective human oversight.
- Appropriate accuracy, robustness and cybersecurity.
Providers carry most of these obligations, while deployers must use systems as instructed, ensure oversight by trained staff and monitor how they operate.
Why does it matter?
Fashion companies employ many people in stores, warehouses and offices, and recruitment or workforce tools increasingly use AI. An AI tool used to screen applicants for store or warehouse roles, or to evaluate employee performance, would likely be high-risk. Getting this wrong can mean fines, legal disputes and damage to employer reputation.
How does AI use it?
This is a regulatory category rather than a technique. In practice it affects how AI tools are procured: brands ask vendors for documentation, conformity information and details on bias testing, and they design processes so that people review decisions affecting individuals.
Common pitfalls
Companies often focus on visible customer-facing AI and miss high-risk uses hidden in HR or finance software. Others assume that buying a tool transfers all responsibility to the vendor, which it does not. A clear inventory of AI uses, early involvement of HR and legal teams and a genuine human in the loop for decisions about people are the most effective safeguards.
Frequently asked questions
Is AI used for recruitment high-risk?
AI systems used to recruit or select candidates, for example by filtering applications or evaluating candidates, are listed as high-risk under the EU AI Act. They must meet strict requirements before and during use.
Are most fashion AI tools high-risk?
No. Typical fashion uses such as product recommendations, demand forecasting or image tagging are generally not high-risk. The category mainly covers uses that significantly affect people's rights or opportunities.