Attached: 1 image
the cyberpunk present is weird as fuck: the latest Shai Hulud malware wave contains an LLM prompt to create biological weapons and nuclear weapons, with the purpose to trip LLM safety refusals so that LLM-based code scanning wont see the malware
https://socket.dev/blog/mini-shai-hulud-miasma-and-hades-worms-target-bioinformatics-and-mcp-developers-via-malicious
I mean is that so different from what we do? My boss says “tools are in the bed”, he could mean an actual bed where people sleep, maybe we’re demoing a house and he placed the tools on a bed. But probably he means the bed of his pickup truck. I assign a probability to each and take the meaning that is most probable.
Yes it is different, because you can reason that out using the context of the situation. An LLM only has the words sent to it, and no ability to analyze whether what it is saying makes sense.
It’s just: you said bed and told, here’s some other words that commonly show up near the word bed, if there’s enough smut in it’s training, it might go a very different direction than your expecting.
I mean is that so different from what we do? My boss says “tools are in the bed”, he could mean an actual bed where people sleep, maybe we’re demoing a house and he placed the tools on a bed. But probably he means the bed of his pickup truck. I assign a probability to each and take the meaning that is most probable.
Yes it is different, because you can reason that out using the context of the situation. An LLM only has the words sent to it, and no ability to analyze whether what it is saying makes sense.
It’s just: you said bed and told, here’s some other words that commonly show up near the word bed, if there’s enough smut in it’s training, it might go a very different direction than your expecting.