Can we use PyRIT on local HF models?

[Doge Coder (EricXQiu)]

Hi PyRIT team,

I'm pretty new here. Can we use PyRIT on local models? We have downloaded a few Hugging Face model on the local storage.

Thanks for any suggestions or help.

[Raja Sekhar Rao Dheekonda (rdheekonda)]

Thanks for reaching out to us. At the moment, we don't have that option available. However, one approach is to deploy the same Hugging Face model to Azure ML using PyRIT's deployment functionality and then utilize PyRIT's Azure ML chat target for probing. We will reply to the issue that you've created if we have any plans to support Hugging Face model as a target.

[Roman Lutz (romanlutz)]

Update: HuggingFaceChatTarget supports this!