With how many lawsuits they get and the total amounts they now have technically lost in court, how is it possible they still hide their hosting infrastructure? Anna’s archive hosts a truly monumental amount of content and its not like its exactly easy to host petabytes(?) of content in secret easily. Hell the orders for hard drives should make it easy to find them. It’s not like they can just tuck a raspberry pi with an Ethernet connection somewhere and throw up a proxy and call it a day. What kind of techniques are required to hide that amount of infrastructure? Especially under such scrutiny as the US government and many publishers coming for their throats I can’t imagine it’s a small feat.

  • Natanael@slrpnk.net
    link
    fedilink
    English
    arrow-up
    68
    arrow-down
    1
    ·
    2 days ago

    Tldr all the site data has an offline copy that can be restored from scratch on endless numbers of types of servers.

    They don’t really hide most of the servers. They simply put them in places where enforcement is slow. Then when the server goes down it doesn’t point at anyone because it’s simply hired anonymously. And then they hire another server and put the data back up.

    • fonix232@fedia.io
      link
      fedilink
      arrow-up
      43
      ·
      2 days ago

      They also have all the data in a set of torrent files.

      I’ve actually been working on an AA client + Readarr (yes yes I know the main project is dead, I meant for generally book-related Arr stack projects) provider.

      The idea is pretty straightforward:

      • the client connects to the current AA instance and grabs the torrents
      • each torrent is added to a built-in client, with all files set to “don’t download” (so at the moment it does nothing beyond peer discovery)
      • each torrent is now versioned and provides a metadata batch of all files and paths included
      • metadata is matched to paths during lookup
      • provider interface allows upstream software (e.g. Readarr, Chaptarr, etc.) to search for a specific release with some extra parameters (language, format, date added, etc.), uses AA approach of hash to path matching
      • path is matched to torrent, within that torrent, that path is set to be downloaded
      • upon download the file path is softlinked to destination provided for download
      • upstream picks up new file and parses it (then it gets passed to CWA, AudioBookShelf, Kavita or whatever other frontend you use)
      • the client also automatically selects 500MB worth of files with low availability. This 500MB is separate from what the user has actually downloaded, and is used to contribute back to the P2P net
      • FaceDeer@fedia.io
        link
        fedilink
        arrow-up
        5
        arrow-down
        1
        ·
        2 days ago

        This seems similar in general outline to Hyphanet, a system for distributed data storage that automatically handles random distribution and distributed searching. Unfortunately I don’t think Anna’s Archive puts its data on there, but perhaps you could consider having your client bridge to that and use it as an additional backup cache.

      • Natanael@slrpnk.net
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 day ago

        Your computer always connects to something using an IP adress which is not hidden. That something can be a proxy or similar to hide another server, but there’s always a visible server.

          • Natanael@slrpnk.net
            link
            fedilink
            English
            arrow-up
            1
            ·
            1 day ago

            That proxy server is visible (that’s my whole point) and can be forced to take it down, and very few use Tor or I2P

              • Natanael@slrpnk.net
                link
                fedilink
                English
                arrow-up
                1
                ·
                1 day ago

                Using cloudflare means you’re using them as a proxy. Cloudflare can be pressured with court orders

                • ryannathans@aussie.zone
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  ·
                  21 hours ago

                  Moving the goalposts. When you have a third party proxy on your first party proxy it’s definitely hiding

                  • Natanael@slrpnk.net
                    link
                    fedilink
                    English
                    arrow-up
                    1
                    ·
                    12 hours ago

                    Not moving the goal posts because if the first proxy in the chain goes down then nobody can connect to your server, even if the rest of the servers are all up