• 0 posts
  • 28 comments
Joined 3 years ago
Cake day: March 22nd, 2024
  • Admittedly, no, but this is slowly improving. Stepfun published their SFT dataset, smaller labs are publishing their datasets for task specific tunes. I believe there was another Chinese lab that published bulk pretraining data, but I can’t find it in my history at the moment.

    And, notably, these comparatively tiny labs generally aren’t scraping the internet so abusively like OpenAI/Meta. They don’t need as much. Going by statements in their papers, they tend to use existing archives of web data, buy commercial data, or (more recently) generate a lot synthetic data.

  • Holy moly.

    That is basically the worst case scenario, no?

    • The absolute last thing Obsidian needs is Bethesda presiding over them. Bethesda (the publisher) is pure toxicity, and don’t they hate Obsidian?

    • They should have given Obsidian TES/Fallout, and folded Bethesda into Obsidian as a studio to farm work out to. BGS has some great level design teams, but the decision makers need to go.

    • The absolute last thing Halo campaigns need is to be more like Call of Duty.

    • They should have cut 343, and split the IP amongst specialized studios. Like an Arkane “special ops” stealth game, another Halo Wars, and/or a strictly multiplayer Activision game.

    This is beyond even my worst expectations. It’s what I would have done if I was a corporate spy inside Microsoft, assigned to sabotage them.