The come back of the Dead Internet Theory? Getting more and more probable by the minute indeed thanks to the newer wave of generative AI text and art.

OK, now this is out and potentially a big deal to have this in open source.

Indeed, this is going to be "interesting" in educational situations... I guess that'll at least push into richer assignments.

Very interesting thought experiment around Copilot's legality. I'd love to see that happen and see what the outcome would be.

There's really a problem with GitHub overall... and the Copilot move is definitely worrying. Not Copilot by itself really but how they just don't want to tackle the questions it raises.

At last we might wake up from the "deep learning alone can solve every problems" fantasy. Looking forward to seeing human interactions and symbol manipulation come back in the AI field. Finding ways to pick and mix approaches is essential. Otherwise it's meant to stagnate and lead to industrial hazards.

Or why we should keep an eye on transfer learning. This is one of the promising way to get a more efficient machine learning process. Might come with its own challenges in methodology complexity though, it'll likely be easy to do it wrong and to notice that too late.

A reminder of why machine learning is currently so power hungry. It's in fact (still) highly inefficient.

Good reminder of the limits of machine learning. There's no clear path from machine learning to more general intelligence. This article doesn't account for emergence effects though. They are a possibility but that's a long stretch from what being exhibited so far: it's "just" statistics.

Looks like an interesting system to recognize bird sounds in the wild. I'll definitely test it.

I think this is the best analysis about GitHub Copilot so far. Clearly using it in production today carries lots of risks. It might improve in the future but only marginally and likely with quite some effort. Not sure it'll pass the threshold to be anything else than a funny toy.

Very nice tutorial, explores a good set of common biases. Also show that it's not that simple to get rid of them.

Interesting, could be a another breakthrough in training performance.

Interesting account on the recent research around self-supervised learning. In my opinion this is still the early days but already gives some interesting results. A good reminder for me to read up more on the energy-based models. :-)

Looks like an interesting book (didn't read it yet, would love an epub version out of the box) about AI and machine learning.