Welcome to my personal notes!

farcaster vis is ~80% done

might do a post on a cool geometry puzzle

September 20, 2023


got leaflet working -> actually good performance

tiles are in weird order though

but very good progress

need to start reading again

the beginning of infinity is gonna take me 2 years at this rate


current projects:

  • PyTorch game
  • Farcaster visualization
  • Go bot
  • QR code + SD
  • canvas quiz bot
  • no new projects until I finish ~2 of these

    September 19, 2023

    got visualization in matplotlib, hard part is getting it to look good/polished

    https://gdal.org/programs/gdal2tiles.html

    little side project would be to make sd QR code generator

    some of them are really cool

    September 17, 2023

    what are the élite institutions that filter for agency instead of intelligence?

    Maybe YC, but it focuses on a single business instead of the founders alone

    there should be a physical buildspace

    September 14, 2023

    all data preprocessing for farcaster visualization is done

    gonna move it to pc, then do training run

    might be able to start today, probably not though

    todos:

  • implement contrastive loss
  • figure out architecture of network(# layers, size of layers)
  • do training run

  • right now similarity is just based on # of replies, not account for recasts or likes

    will add that in the future

    September 10, 2023

    why is IQ the proxy for how smart someone is, when ability to have novel ideas seems more important?

    Who are the greatest minds in ~recent past?

    feynman's iq was supposedly just above average, yet it is universally agreed that he was incredibly smart

    Jobs and Musk's iq are "estimated" to be really high, but that is due to people correlating IQ with novel-ness

    the two could definitely be related but it's certainly not the rule

    people with very high IQ are going into Quant finance, not become writers/builders/artists

    there should be a way to quantify how contrarian someone is

    the point is that the greatest minds in history are known for creating new things and having new ideas, which doesn't seem to be concretely linked with IQ


    wonder if you can use ~TikTok as reward mechanism

    like how people will smoke a cigarette after being productive

    seems to be just as stimulating/addictive


    got local farcaster hub running

    going to make visualization of accounts based on interactions(since there is no following[i think])

    September 9, 2023

    good progress on pytorch game today


    cool use case of llms is indexing/searching through files

  • emails
  • photos
  • music
  • September 8, 2023

    need to automate all schoolwork

    todos for homework bot:

  • build/find model to crop image to relevant/main text
  • determine what kind of question it is
  • do OCR + feed to gpt4

  • for pytorch game, could write script that takes in pytorch doc link, and creates question based on it

    can also add chat so user could ask questions specifically about that torch method

    need to become a gwern type mf

    September 6, 2023

    todos for homework project:

  • find good OCR tool
  • figure out how to recognition to get main question of image
  • parse text in formatted way
  • send to gpt4

  • might just work on pytorch game this morning though

    September 5, 2023

    has anyone made a general use Photomath

    could be a fun way to get into computer vision

    could have a couple different use cases:

  • photomath (canvas quiz or paper)
  • google docs
  • general tutor that could take in youtube videos, pdfs, etc.
  • September 4, 2023

    maybe pytorch game is better as a companion to the docs

    not sure how to turn it from tutorial to game

    policy network is not converging

    September 1, 2023

    gonna get first training run done tonight

    todos:

  • finish policy network
  • read BofI
  • start anon twitter
  • write out ideas for pytorch app
  • August 29, 2023

    need a way to tell model whose turn it is

    otherwise it might generalize to a move suitable for both

    can just make first dimension current player's stones, and other one is opponent

    instead of 0 = white, 1 = black

    August 28, 2023

    made cool visualization for go game

    just demonstration that I am getting correct board state at any given move

    should be able to start on policy network tomorrow, since training data is in correct format now

    August 27, 2023

    https://buttondown.email/surya/archive/suffering-from-success-2028/

    August 26, 2023

    todos:

  • finish zero to one?
  • start policy CNN for go bot
  • deploy/populate reading list
  • music gen post

  • finished zero to one

    absolute banger


    reading log is deployed

    need to figure out whether new home page is good idea or not

    published to website, may change in the future

    August 25, 2023

    too tired to do anything useful

    gonna build reading list rn

    August 24, 2023

    https://github.com/featurecat/go-dataset

    first step of go bot is policy network (just CNN trained on pro games)

    should be relatively straightforward


    good paper to base policy network on

    https://arxiv.org/pdf/1412.3409.pdf

    could be cool to look at what different layers of cnn will capture

    this paper addresses symmetry of the board in a cool way

    “All Rhodes Scholars had a great future in their past”

    zero to one is really good so far

    August 23, 2023

    https://arbital.com/p/bayes_rule/?l=1zq

    despite being a little verbose, there is probably some alpha still on LessWrong

    lots of value in understanding bayesian thinking and rationality

    even if just to understand doomer args


    really need to read SICP

    have had the book for months now

    no better time than the present

    gonna get reading list up as a way to apply social pressure


    ok im making new home page

    done with new home page

    not gonna push it till reading log is done

    https://www.youtube.com/watch?v=iGLzWdT7vGc&t=1835s

    August 21, 2023

    there are so many things to learn

    need to read more about

  • ideological movements (BAP, populism)
  • history of US
  • philosophy (~nietzsche)
  • history of religion
  • coming up with smart/interesting ideas seems to work the same as coming up with good startups according to pg

    first you need to get to the edge of innovation, then look for holes

    to have interesting commentary about politics/culture/economics, you first need to grind your way to the edge

    read more books, use twitter/instagram/distractions less


    become a well-read autodidact builder


    things to be working on:

  • post for music generation (maybe need to improve model)
  • poker model
  • pytorch game
  • reading list
  • new website layout
  • first gonna make a go bot instead of poker

    might be harder to make it really good, but is much more straightforward due to complete information

    would also be cool to add to my website

    https://www.nature.com/articles/nature16961

    seems like only new topic is tree search

    saying that like it is trivial

    August 19, 2023

    for poker model, will probably have to start with heads up(only 1 other player)

    need to encode all information about a hand, including bets up to this point

    betting pre-flop vs post-flop are very different

    basic probabilities are easy to compute

    information required per hand:

  • my cards
  • # of chips vs opponent's chips
  • flop,turn,river
  • flop,turn,river bets
  • order(who is going first)

  • things to decide:

  • fold
  • call
  • raise (by how much?)

  • data might be hard to find

    http://poker.cs.ualberta.ca/irc_poker_database.html

    slightly sketchy dataset:

    http://web.archive.org/web/20110205042259/http://www.outflopped.com/questions/286/obfuscated-datamined-hand-historieshttp://kevinwang.us/lets-analyze-pluribuss-hands/https://archive.ics.uci.edu/dataset/158/poker+hand

    August 18, 2023

    could keep randomness by sending two functions to run, that both compute answer

    has anyone made poker bots

    that they could then use for online games

    this doesn’t seem that hard to build


    problem with poker model is that you don't want to recreate average player

    (what you'd get by training on all games)

    instead, need some kind of decision tree like alpha go

    might work if you get a bunch of pro games

    but they would be playing against other pros, which you don't playing against other players


    maybe v1 is just on pro games

    later version could be alphaGo-style decision tree

    August 16, 2023

    I have gotten nothing done in the past ~2 weeks

    Need to build/read/learn

    August 9, 2023

    who is making decentralized gpu compute

    also would be fun to check out smallville agents

    https://arxiv.org/abs/2304.03442

    Need to update site

    Move current one to ‘old’ subdomain

    Maybe just an html page? Looks more aesthetic + faster load time

    react is too bloated

    Todos:

    reading log page

    new homepage

    write levels for pytorch game

    create three animation for game

    Refactor


    Want it to look something like this

    https://sigilwen.ca/

    become an autodidact

  • need to lay out things to learn
  • then actually learn them
  • stop using Twitter/YouTube
  • August 8, 2023

    solution is serverless functions(aws lambda)

    making solid progress

    can run pytorch code and get output

    todo:

  • handle for exceeding memory/time
  • start writing questions
  • build way to validate answers
  • August 7, 2023

    once set up at school ill resume the music generation development

    for now just gonna work on pytorch game

    gonna take physics or chem next semester

    need to become more versed in hard sciences

    CS classes are likely going to be fairly straightforward until sophomore year


    problem is that python-shell cant install torch on every run

    probably gonna have to set up instance that will run the code😔

    August 3, 2023

    hoping its the former


    fun tool would be coding puzzles you solve with pytorch

    has anyone made that?

    i.e. beginner puzzle would be make tensor of this shape that has these properties

    might be hard to make more complicated puzzles though

  • take sum across this dimension
  • normalize across that dimension
  • complicated levels would be to get a model to a certain loss

    something like kaggle but more game-like

    codeMirror as editor

    python-shell to run code on nodejs

    https://codemirror.net/5/index.htmlhttps://www.npmjs.com/package/python-shell

    should be a game though, not a test

    something like this:

    https://www.apple.com/swift/playgrounds/