Anyone can level a charge of AI writing, but it's getting to the point that you must write sloppy to seem human. and never never write well with clear technical prose. It is getting to be just ridiculous McCarthyism.
It is still helpful I believe, but your point is well taken. The problem is that we have relatively few tools for monitoring alignment, and longer loops of processing that stay in latent space means less ability to monitor.
The major concern with looped transformers is that makes it more difficult to monitor model alignment. When more processing occurs within latent space without outputting text, that means less effective, frequent chain-of-thought monitoring, and the potential for greater un-monitored latent-space shenanigan.
I am no expert, but I think it is this: 1) We have few effective tools at monitoring alignment right now, and chain of thought is one of the more effective. 2) Monitoring latent space may be possible, but I do not think it is even close to being a solved problem, nor whether it is possible at scale and outside of controlled problem areas. 3) Finally, more recursion within latent space may complexify the latent representations, not simplify them.
This is silly, the entire reason why chain of thought even exists is to let the LLM "think independently" instead of minimizing the deviation from the supervised training sample. It's an intentional scratch pad for intermediate data. The loose monitoring is kind of the entire point.
Alpha Fold has continued to impact the field of protein networks, but I do hear that not every one of the deep learning biology models from Google/Deep Mind and others have made equivalent impact or had as lasting relevance in their respective domains..some have performed more poorly than other available models. I'd love to learn more about this, but this has mostly come from little snips of conversations here and there, in person and online, but I haven't seen anything comprehensive in terms of evaluating their impacts overall
So California wet year. We don't mind a good snow pack, but I've become increasingly worried about catastrophic flooding evens in Cali e.g. [1], and this does not ease those worries.
I also experienced vertigo, but I'm particularly prone to vertigo induced by 3D scenes. Still, I think this is the first time a screen as small as my phone did it.
There is interesting evidence that autism-autism social interactions are fairly vibrant. Everything is a bit more complicated than simple answers, no matter which way you swing.
Autism is a spectrum. Neurodiversity within and outside of autism is both intrinsically valuable and extrinsically valuable to society. However, not all phenotypes of autism should be viewed as neurodiversity, but as harmful. There is only so much that society can do to make severe intellectual impairments less disabling without identifying a cure for the intellectual impairment. The debate between medical versus disability models, neurodiversity versus pathology, inevitably gets pushed by those that want to classify everything into clean essentialist boxes, but that, I do not believe, is a helpful way to view the world. Not every condition is a pathology, nor is every condition benign if only society would do more to make it less disabling.
reply