• 0 Posts
  • 45 Comments
Joined 3 years ago
cake
Cake day: June 14th, 2023

help-circle
  • I have the same doubts… it’s very easy to count how much text it cuts out but it means nothing without benchmarks that show accuracy isn’t hurt.

    There’s certainly things that are just not needed. But even permissions and owner in ls has cases where it’s useful - if the agent needs to debug a permission issue and ls doesn’t work, it will figure out some other way, and that takes tokens. Hopefully you’re not debugging permissions often though.

    I also have no idea if the unchanged lines in a diff are noise or if they help the LLM. What if the context around the changed lines is really helpful? We can’t just decide that parts humans don’t need are useless. I mean there’s literally research showing that even repeating the prompt can improve accuracy.





  • Nowadays agents like Claude Code can run autonomously for hours just given a goal description. It doesn’t take a lot of human effort at all to set up a bunch of sessions, and these companies don’t limit how many instances you run in parallel. Agents can also spawn sub-agents that run in parallel if a task calls for parallelization. Whether all this produces good results is a different story, especially if you don’t put enough effort into the goal description. But burning tokens as such is not difficult.

    Even workflows where you’re just chatting with an agent can burn a lot of tokens. When you’re chatting with an LLM, the entire history becomes part of the input each time you send something. This also applies to tool calls, so if the agent decides to read 20 files before it can work on your request that’s 20 times a file gets added to the history and 20 times that entire growing history is then sent back as input to drive the agent’s next step.

    Coding is more affected by this than many other applications because even a new conversation tends to start with the agent gathering a bunch of source code files, and then the response to a task is not just a bunch of text once, but a sequence of tool calls to make edits across files, build, run tests, react to test failures, and so on, all for one actual human prompt - but in reality a back-and-forth between the LLM and the harness with a quickly growing history.


  • They didn’t tell them to pull it, they told them to revoke access from non-US nationals. Similar to export control rules for cryptography that have existed for a long time. PGP got its author a criminal investigation back in the day.

    Now Anthropic can’t guarantee a restriction to US nationals so Anthropic pulled it instead.

    They probably have some internal problems with this too. They just hired Andrej Karpathy (one of the founders of OpenAI) - he’s a Greencard holder but not a US national.

    You can be mad anyway of course, but maybe more in the context of a government stake in OpenAI being discussed recently and the conflict of interest this brings. Export control by itself isn’t new though.









  • Japan has been doing cashless forever. Most local/regional transport operators use IC cards. The tech is Sony’s FeliCa and the major ones are compatible nationwide. It’s also built into modern smartphones, although it’s only generally available on phones sold in Japan except for iPhone, where all models worldwide support it. If you’re on iPhone, even as a tourist you can just create a virtual card in Apple’s Wallet app and charge through Apple’s payment service.

    JR East’s card is called Suica and exists since 2001. It covers basically anything in the Greater Tokyo area where they operate, not only their own stuff (trains, metro, subway, trams, the airport monorail, buses, some ferries, …), and can be used for payment at many shops, vending machines, restaurants, and even some parks and such. Billing for transport is generally simply by shortest distance. E.g. riding the Yamanote ring line one stop in one direction costs the same as going all the way around the ring in the other direction.

    Shinkansen (bullet trains) don’t use the cards for payment, but you can link online ticket purchases to them and then you buy cashless online and only tap in and out for the Shinkansen too.

    Recently some train operators have started supporting credit cards too, so for some trains you can just tap a credit card at the ticket gates.