• 1 Post
  • 49 Comments
Joined 1 year ago
cake
Cake day: July 6th, 2023

help-circle




  • AWS has multiple teirs of storage options in s3, some replicate and some dont. by default those that do replicate do so in multiple availability zones, but not across regions. unless you turn on cross-region replication (CRR) which is an additional charge.

    So, for example without CRR if your bucket is in us-east-1 and 1 availability zone goes down you can still access the data, but if all of us-east-1 is down, you cannot.









  • the NSA (which lacks a mandate to act on US soil, and CF is a US company)

    They absolutely do have a mandate to operate on US soil, that is actually the main mandate and there is a separate military agency (CNMF) that operates on foreign soil. They are both headed by the same guy though so they might as well just be one agency.




  • There is one extra step. I have an 6700xt, and with the docker containers, you just have to pass the environment variable HSA_OVERRIDE_GFX_VERSION=10.3.0 to allow that card to work. For cards other than 6000 series, you would need to look up the version to pass for your generation.

    Here’s an example compose file that I use for ollama that runs ai models on my 6700xt.

    version: '3'
    services:
      ollama:
        image: ollama/ollama:rocm
        container_name: ollama
        devices:
          - /dev/kfd:/dev/kfd
          - /dev/dri:/dev/dri
        group_add:
          - video
        ports:
          - "11434:11434"
        environment:
          - HSA_OVERRIDE_GFX_VERSION=10.3.0
        volumes:
          - ollama_data:/root/.ollama
    
    volumes:
      ollama_data: