blog: thomasdouwes.co.uk
I also run some bots:
@FlagWaverBot

  • 2 Posts
  • 13 Comments
Joined 1 year ago
cake
Cake day: June 2nd, 2023

help-circle



  • I have done some testing and I found a few reasons I’m having issues with webtorrent:

    • The only reason they where working at all is because they were downloading from the HTTP URL in the torrent file, P2P was not working at all.

    • To download the webtorrent from the blender instance I need to have the video watched in my browser to peer with the webtorrent client, the instance peers don’t work on non-peertube webtorrent clients.

    • The reason instant.io was broken is my adblocker was blocking the tracker.

    • The tracker in my peertube instance is broken.

    EDIT:
    I was a bit wrong here, there are two different formats in peertube: webtorrent and HLS. I was getting confused why the video on my instance (HLS) and the one on the blender one (webtorrent) was behaving differently with webtorrent clients. They are completely different formats so that makes sense now.


  • Webtorrent seems to have some issues with peer discovery. I’ve tried the instant.io site they have linked on webtorrent.io and I can’t get it to download or share anything, the desktop client managed to download a torrent from my peertube instance over normal BitTorrent but I can’t share it over webtorrent. I downloaded a video from my peertube instance using btorrent.xyz over webtorrent but I can’t seed new files because the peers don’t find each other. when I use a webtorrent with a tracker (like peertube) it works fine but how were sites like instant.io supposed to discover peers without trackers? I don’t think DHT exists for webtorrent yet.

    You can manually seed videos on instances using redundancy but I was thinking automatic redundancy for watched videos might be a good idea, I guess you can do automatic redundancy for entire instances but that would take up a lot of storage space.

    One of the nice thing with BitTorrent is the high reliability so I assumed that was what peertube was trying to do, I guess the idea is not to provide data redundancy but to split load instead?








  • Download ML thing.
    make new venv.
    pip install -r requirements.txt.
    pip can’t find the right versions.
    pip install --update pip.
    pip still can’t find the right versions.
    install conda.
    conda breaks for some reason.
    fix conda.
    install with conda.
    pytorch won’t compile with CUDA support.
    install 2,000,000GB of nvidia crap from conda.
    pytorch still won’t compile.
    install older version of gcc with conda.
    pytorch still won’t compile.
    reinstall the entire operating system with debian 11.
    apt can’t find shitlib-1.
    install shitlib-2.
    it’s not compatible with shitlib-1.
    compile it from source.
    automake breaks.
    install debian 10.
    It actually works.
    “Join our discord to get the model”.
    give up.



  • I hate reddit. But it feels like the library of Alexandria burning down (yea I know). All those google search results and educational subreddits that are shutting down forever, and because they are too small reddit won’t force open them again.
    A lot are in the pushshift archive, but that cuts of at 2022. Also, it doesn’t include a lot of the smaller subreddits.
    I have had my PC running 24/7 with multiple VPNs to avoid rate limits downloading as much as I can before the API dies, but with some blackouts moving forward a day I have already missed a few.
    Like many others, I would often add “reddit” to the end of my searches to get better results, half the websites on web searches now are either AI generated, copies or are completely AD ridden websites that ask you to turn off your AD blocker.