Ask HN: Can world models lead to racisim? Are there any Alignment frameworks?
I have never felt or believed in Dooms day theories about AI. But below is one of only 2 occasions where I am feeling AI can be too dangerous.
While building world model for enterprise decisions, I am intrigued by how far the AI can go out of reach.
Got to know - that now world models can learn from emotions & genetics.
That means - actually predicting the outcome & behavior of humans. If going unabated - so the builder can bring in bias. It sounds Deja vu for when the racist theories developed in wraps of the scholarly research in 1900s.
When I understand how the world model is gonna work - practically emotions & genetics aren't very far away from being built. There are already startups working on it.
While ours is only for Enterprise decisions, the one on genetics as world-wide population scale impact.
For World Models for Physical AI or Humanoids - this is more of physical tasks. I don't call it dangerous as there are quite a few checks & controls.
But when world models are used for Genetics - this has far reaching unabated repercussions on how humans bheave with each other. As models become more powerful, ppl will start relying on it.
I am not sure how the alignment of World Models will happen? LLMs are tbh primitive in nature.
For World Models alignment - are there any specific efforts or initiatives wroking on it?
We would be glad to include any alignment frameworks in our Benchmarking for Enterprise decisions. To monitor & remove bias.
Comments URL: https://news.ycombinator.com/item?id=50542286
Points: 3
# Comments: 0