nostr:nprofile1qy2hwumn8ghj7un9d3shjtnyd968gmewwp6kyqpq25ys6m6zxxdggtg8vtcycfv2pzmv44h6lsne9d0gy6hz6nd3epvsa3q2xw I am confused why we're talking specifically about getting access to no-guardrail mode...
@nprofile1q...
So, correct me if I'm wrong, but Hugging Face ran into a brick wall early in their incident response process when they were blocked by one or more models from analyzing security log data due to guardrails. Their work around was to use a Chinese-sourced open weight model with fewer guardrail restrictions. Part of OpenAI's response to this debacle was to offer to enroll Hugging Face into their trusted access program, which is clearly marketed as providing at least infosec functionality, implied to include some functionality that Hugging Face struggled to access past guardrails. Some invite-only portion of OpenAI's trusted access program includes further loosening of guardrails to allow even greater use in the infosec domain, although it's not clear to me that Hugging Face is approved for that specifically.
For me, the fundamental issue is that the set of potential GenAI model users with legitimate requirements for so-called dual-use functionality (e.g., common infosec use cases) is so large as to be unmanageable at scale.
So, correct me if I'm wrong, but Hugging Face ran into a brick wall early in their incident response process when they were blocked by one or more models from analyzing security log data due to guardrails. Their work around was to use a Chinese-sourced open weight model with fewer guardrail restrictions. Part of OpenAI's response to this debacle was to offer to enroll Hugging Face into their trusted access program, which is clearly marketed as providing at least infosec functionality, implied to include some functionality that Hugging Face struggled to access past guardrails. Some invite-only portion of OpenAI's trusted access program includes further loosening of guardrails to allow even greater use in the infosec domain, although it's not clear to me that Hugging Face is approved for that specifically.
For me, the fundamental issue is that the set of potential GenAI model users with legitimate requirements for so-called dual-use functionality (e.g., common infosec use cases) is so large as to be unmanageable at scale.