microsoft The company has announced a tool that prevents users from tricking artificial intelligence chatbots for malicious purposes.
The tech giant has rolled out a series of products for itself. Azure AI The system includes tools to block so-called “prompt injection” attacks, according to a blog post on Thursday (March 28).
“Prompt injection attacks are emerging as a significant challenge, allowing malicious attackers to manipulate AI systems into doing things other than their intended purpose, such as creating harmful content or exfiltrating sensitive data. will do.” sarah birdMicrosoft's Chief Product Officer for Responsible AI wrote in the post.
“In addition to mitigating these security risks, organizations are also concerned about quality and reliability,” Bird added in the post. “They want to make sure their AI systems don’t generate errors or add information that isn’t substantiated in the application’s data sources, which can undermine user trust. ”
Some of the tools currently available or soon to be released include Prompt Shield to detect and block prompt injection attacks, and “grounded” detection to discover them. AI's “hallucination””, per post
Microsoft will also soon launch safety system messages to “guide model behavior toward safe and responsible outputs,” and is currently working to determine an application's vulnerability to jailbreak attacks and creating content risks. The post said it is previewing a safety evaluation for the
Earlier this week, PYMNTS examined Microsoft's role in “The Next Battle.” Generation AI” was started with the success of “ Chat GPTdeveloped by Microsoft partners OpenAI.
Microsoft and Google The battle for the AI crown involves more than just big tech companies.
open source project, collaboration, and a focus on ethics and accessibility are emerging as factors in the fight to unseat OpenAI. Pushing the boundaries of AI often requires investment in computational power and research talent.
“A hurdle in building extensive foundational models is that training on increasingly large datasets is prohibitively expensive.” Gil LuriaSenior Software Analyst DA Davidson & Co.said in an interview with PYMNTS. “The only reason OpenAI can afford to do so is because of the support of Microsoft and the Azure resources it provides to OpenAI. We continue to incorporate parts and training with new content, making it versatile in many disciplines.”
For all of our coverage of PYMNTS AI, subscribe to our daily subscription AI Newsletter.