I weirdly was running into an issue where whenever a ⌘F search didn’t return a result, my screen would flash white. It was irritating me for several days. Fortunately, I was able to find a solution that addressed it.
sudo killall coreaudiod I was writing code with claude-3.5-sonnet and prompted it to add input validation for input arguments.
Most of the code what straight forward and I was expecting the one sentence prompt to get me 5-10 lines of code with path validation, I did not expect these lines.I’m trying to avoid buying too much into the hype (maybe it’s too late), but here are several folks talking about their notably impressive experiences with claude-3.5-sonnet.
https://twitter.com/SullyOmarr/status/1804656718283935845 https://twitter.com/jdjkelly/status/1804226265886363719 https://twitter.com/mattshumer_/status/1804519779077636459 https://twitter.com/alexalbert__/status/1803804677701869748 https://twitter.com/marissamary/status/1804172736488415593As I noted in this post, I am going to spend more time interacting with smaller models to try and build more intuition for how LLMs behave and the different flavors in which they respond. Today, I spent some time chatting with Microsoft’s phi-3 3B using ollama. In chatting with phi3, I found it neutral in tone and to the point. It responds in a way that is easy to understand and is not overly complex or technical at the onset.I enabled Cursor’s Copilot++ today. Magical. So much better predictive capabilities than Copilot. The way it anticipates my needs is pretty cool. Edit: It’s not great for writing markdown or only prose.
I learned a bit more about Crafter, a Minecraft like game that language models can play.I enjoyed reading Jordan’s post, a walk down memory lane of his career so far through a series of emails. He includes things like following up on internship opportunities, negotiating, and meeting people who would change the course of his career. He inspired me to look back through some old emails as well, both to remember this time and acknowledge how much has changed since then.
I managed to find my original offer letter from Uber in 2016, which brought back many memories that I might write about in longer form sometime in the future.For the first time in a while I used iTunes. I mean the Music app, sorry. I clicked on the album art while I was playing a song and the app switch to mini-player mode. I…didn’t see what I could click to get back to the main player. From my perspective the app had just shrunken down to the mini-player. I hesitantly clicked the lyrics button. Yeah, definitely not that. I clicked the red button of the traffic lights.Eugene’s article on prompting is one of the best things I’ve read recently, full stop. As also noted by Kyle, try starting with 0.8 temperature and lower only if necessary, even for deterministic use cases1 2.
https://eugeneyan.com/writing/prompting/#selecting-a-temperature ↩︎
https://twitter.com/corbtt/status/1801026166020833457 ↩︎A few years old, excellent response written by Maxim about extracting the most value from Temporal by using it “as a service mesh for invocations of child workflows and activities hosted by different services”.I found a very satisfying, time-saving use of a model though Cursor to generate an inline shell script to reformat some data for me. The goal was to reformat json files that looked like this
[...] to ones that look like this
{"cells" [...]} I used the following prompts:
for each json file in the current folder, read the json (which is a json list) and turn it into a json object with a single key, “cells” whose value is the json listSo Apple has introduced a new system called “Private Cloud Compute” that allows your phone to offload complex (typically AI) tasks to specialized secure devices in the cloud. I’m still trying to work out what I think about this. So here’s a thread. 1/
— Matthew Green (@matthew_d_green) June 10, 2024 Matthew wrote a thread summarizing Apple’s private cloud and their security approach. Between the speed at which models are changing and their size, it’s not currently practical to run things like LLM inference on iPhones, at least not for the best available models.