I joined Lemmy back in 2020 and have been using it as @qaz@lemmy.ml until somewhere in 2023 when I switched to lemmy.world. I’m interested in systemd/Linux, FOSS, and Selfhosting.

  • 225 Posts
  • 1.59K Comments
Joined 3 years ago
cake
Cake day: June 10th, 2023

help-circle




  • Companies like Claude with their AI subscriptions might be losing money, but I doubt paid-per-token AI API usage is not making them money. There are several companies like e.g. DeepInfra and Fireworks that have sprung up to sell specifically that. I don’t think simply multiplying API cost with expected usage is sufficient to estimate how much will be charged however, because I suspect that OpenAI and Claude currently have a significant profit margin since they seem to be the defacto duopoly in the US.

    The chart above shows that quite clearly, the vertical axis is the combined score on various benchmarks. The horizontal axis shows the price. OpenAI and Claude do score higher, but the price difference is enormous, even if it wasn’t a log scale (70$ vs 1.3k$ for similar results!). The competition of these companies could drastically reduce the margins of US companies,

    I therefore think the pricing will depend on whether the large US AI companies manage to lobby the government to enact laws to cripple the competition of Chinese companies under the guise of security.






























  • For the people expecting this to be a CPU with a big-little architecture or NVIDA GPU, it was both.

    The Lenovo ThinkPad P1 Gen 8 review unit is equipped with an Intel Core Ultra 7 255H “Arrow Lake H” Processor, 64GB of LPDDR5-7467 memory, NVMe storage, and NVIDIA RTX Pro 1000 graphics. The Intel Core Ultra 7 255H consists of 16 cores between six P cores, 8 E cores, and two LPE cores. The Core Ultra 7 255H has a 28 Watt base power rating and 115 Watt maximum power rating.

    There used to be performance issues with mixed P and E cores and Linux, but I thought that was solved. Could that still be causing this discrepancy?