Notes

Reproducibility is a bedrock of scientific progress An underlying principle that governed my doctoral research [1] in applying representational learning to understand reproducibilty, was the idea that “Reproducibility is a bedrock of scientific progress” [2]. Naturally, seeing Thinky talk about non-determinism and reframing the discussion around reproducibility in large language models made me realize, that reproducibility has become an ideal that fewer and fewer researchers, engineers, hobbyists alike believed truly across any scientific project. ...

Lately there is an surge in explosion of models, recipes and software libraries that are capable of doing deep research. The nature of what constitutes as a deep-research task would really depend on the person you’re asking but its undeniable that any deep-research query is i.) agentic, ii..) long-horizon, iii.) large scale information seeking and iv.) information consumption workflow. Deep-research agents can be used for various search directives, but they scour the information at a considerably high depth, gather the context of all of the crawled information into a final answer that hopefully gives valuable insights.[1]. Inherently, this is a huge time and effort saving exercise if the report generated in the end is of high quality. ...

Context Sustaining the habit of writing is incredibly hard and something I’ve recognized is quite challenging to sustain. I really like looking at my notes and keeping my mechanical part of my brain active to ensure my recall capacity is fully functional. Although it seems pointless to other, I’ve always considered my daily notes as a great source of comfort because I know there is one place I can reliably go and fetch information that I’ve come across when I’m tinkering something random. That said, why do this publicly, well after observing a lot of people give me raised eyebrows when they look at my obsidian notes coupled with the fact that I’ve been recommended to have my notes made public, I gave into the idea that there is some public utility to my notes. But I guess more importantly, there is greater benefit for me to fetch important information when needed/required immediately (+1 if its on the web). ...