-
Python
,UV
,Today I Learned
🤷 UV does everything or enough that I'm not sure what else it needs to do
UV feels like one of those old infomercials where it solves everything, which is where we have landed in the Python world.
I have had several discussions with friends about UV, and even when we talk about it during my weekly(ish) office hours, the list has grown to an ever-growing number of options.
UV started as a quicker way of installing Python packages, and now it’s easier to tell people that UV does everything and to focus on what it doesn’t do.
My favorite feature is that UV can now bootstrap a project to run on a machine that does not previously have Python installed, along with installing any packages your application might require.
Here is my incomplete list of what UV does today:
uv pip install
replaces pip installuv venv
replacespython -m venv
uv pip compile
replaces pip-tools compileuv pip sync
replaces pip-tools syncuv run
replaces pipxuv tool run
replaces pipxuv python
replaces pyenv, asdf, mise, and several other like-minded toolsuv build
- Build your Python package for pypiuv publish
- Upload your Python package to pypiastral-sh/setup-uv
brings UV to GitHub Actionsghcr.io/astral-sh/uv:latest
brings UV and Python to Docker
I copied these four from
uv --help
, which feels like poetry features.uv add
- Add dependencies to the projectuv remove
- Remove dependencies from the projectuv sync
- Update the project’s environmentuv lock
- Update the project’s lockfile
So what doesn’t UV do?
UV does a lot, but it still needs to do everything.
- UV doesn’t run custom scripts defined in our
pyproject.toml
likenpm-run-script
allows. Thank you to @command_tab for jogging my memory. - UV doesn’t convert my non-UV-based projects to UV. Converting is more about prefixing and replacing my commands to switch over.
- UV doesn’t manage, and bump version numbers like the BumpVer, and others do.
- UV doesn’t manage pre-commit like hooks. This is a long shot, but I’d love to see support via
pyproject.toml
. - UV doesn’t replace Python, nor should it.
-
Today I Learned
Please publish and share more
Friends, I encourage you to publish more, indirectly meaning you should write more and then share it.
It’d be best to publish your work in some evergreen space where you control the domain and URL. Then publish on masto-sky-formerly-known-as-linked-don and any place you share and comment on.
You don’t have to change the world with every post. You might publish a quick thought or two that helps encourage someone else to try something new, listen to a new song, or binge-watch a new series.
This week, I have encouraged at least half a dozen people to blog something, and at least three of them were happily surprised to see their work re-posted by another friend or published in a newsletter.
I have nothing against masto-whatever-you-use-this-week or blue-sky-levels-of-vc-money or formerly-called-no-one-cares, but those platforms are hard to share an article on.
So, even if you re-publish to thread your post infinitely, please find a cheap or free publishing platform and own your work. GitHub Pages is a free way to publish your work via GitHub, and they will let you use your own domain name for free.
You don’t need an editor
I used to ask my friends to review my work, and I still sometimes do. Then I realized that 99% of the time, it doesn’t matter.
I pay for Grammarly because I have Dyslexia, and it helps me communicate better. But you don’t have to.
You can use a free tool like LanguageTool, which has an online version that will let you copy and paste your writing into a free, no-login-required Grammar checker. This is more than the average person will do, and it’s a quick and free gut check.
Not every gift needs a bow
Our posts are done when you say they are. You do not have to fret about sticking to landing and having a perfect conclusion. Your posts, like this post, are done after we stop writing.
PS: Write and publish before you write your own static site generator or perfect blogging platform. We have lost billions of good writers to this side quest because they spend all their time working on the platform instead of writing.
-
📝 Even "bad" code is admirable
Some of my favorite projects are what we would consider really “bad” code, but their apps either work or sort of work.
There are no feature branches—only a main branch.
They don’t open pull requests or spend time on the dozens or hundreds of open pull requests.
The commit message stream is nothing but “updates” or “fixed” commit subjects.
They leave you feeling that each commitment will be the last before they never touch the project again.
They aren’t playing by any rules because they are only focused on the problem they are working on.
They owe us nothing, and yet they are sharing their work.
The project is only complete after they have scratched the itch and moved on to another project.
-
Justfiles
,Today I Learned
TIL Justfiles can also be Just Scripts
Please note: passing an argument like
--justfile
It only works on MacOS and on Linux.TIL that Justfiles can turn into Just Scripts by adding
#!/usr/bin/env just --justfile
to the top of the file and runningchmod +x
on the file.From the docs:
By adding a shebang line to the top of a
justfile
and making it executable,just
can be used as an interpreter for scripts: https://github.com/casey/just?tab=readme-ov-file#just-scriptsjust.sh
#!/usr/bin/env just --justfile @_default: just --justfile just.sh --list @lint *ARGS: uv --quiet run --with pre-commit-uv pre-commit run {{ ARGS }} --all-files
After you run
chmod +x just.sh
, this file may be run using./just.sh
, and sub-commands everythingjust <subcommand>
will just work.Please note that
--justfile just.sh
is needed if you want your Just Script to be able to introspect or call itself.Why?
More and more of my clients are using Justfiles, and occasionally, I want some other recipes that may belong outside the default workflows. These can also be reusable between projects for some of my other internal tooling, so it’s an excellent resource to learn about.
-
Python
,Docker
,UV
,Today I Learned
📓 My notes on publishing a Python package with UV and building a custom GitHub Action for files-to-claude-xml
My new Python application files-to-claude-xml is now on PyPI, which means they are packaged and pip installable. My preferred way of running
files-to-claude-xml
is via UV’s tool run, which will install it if it still needs to be installed and then execute it.$ uv tool run files-to-claude-xml --version
Publishing on PyPi with UV
UV has both build and publish commands, so I took them for a spin today.
uv build
just worked, and a Python package was built.When I tried
uv publish
, it prompted me for some auth settings for which I had to log in to PyPI to create a token.I added those to my local ENV variables I manage with direnv.
export UV_PUBLISH_PASSWORD=<your-PyPI-token-here> export UV_PUBLISH_USERNAME=__token__
Once both were set and registered,
uv publish
published my files on PyPI.GitHub Action
To make
files-to-claude-xml
easier to run on GitHub, I created a custom action to build a_claude.xml
from the GitHub repository.To use this action, I wrote this example workflow, which runs from files-to-claude-xml-example
name: Convert Files to Claude XML on: push jobs: convert-to-xml: runs-on: ubuntu-latest steps: - uses: actions/checkout@v4 - name: Convert files to Claude XML uses: jefftriplett/files-to-claude-xml-action@main with: files: | README.md main.py output: '_claude.xml' verbose: 'true' - name: Upload XML artifact uses: actions/upload-artifact@v4 with: name: claude-xml path: _claude.xml
My GitHub action is built with a
Dockerfile
, which installsfiles-to-claude-xml
.# Dockerfile FROM ghcr.io/astral-sh/uv:bookworm-slim ENV UV_LINK_MODE=copy RUN --mount=type=cache,target=/root/.cache/uv \ --mount=type=bind,source=uv.lock,target=uv.lock \ --mount=type=bind,source=pyproject.toml,target=pyproject.toml \ uv sync --frozen --no-install-project WORKDIR /app ENTRYPOINT ["uvx", "files-to-claude-xml"]
To turn a GitHub repository into a runnable GitHub Action, an
action.yml
file needs to exist in the repository. This file describes the input arguments and whichDockerfile
or command to run.# action.yml name: 'Files to Claude XML' description: 'Convert files to XML format for Claude' inputs: files: description: 'Input files to process' required: true type: list output: description: 'Output XML file path' required: false default: '_claude.xml' verbose: description: 'Enable verbose output' required: false default: 'false' version: description: 'Display the version number' required: false default: 'false' runs: using: 'docker' image: 'Dockerfile' args: - ${{ join(inputs.files, ' ') }} - --output - ${{ inputs.output }} - ${{ inputs.verbose == 'true' && '--verbose' || '' }} - ${{ inputs.version == 'true' && '--version' || '' }}
Overall, this works. Claude’s prompting helped me figure it out, which felt fairly satisfying given the goal of
files-to-claude-xml
. -
Gaming
🎮 The Legend of Zelda: Echoes of Wisdom review 👍
My oldest kiddo and I finished The Legend of Zelda: Echoes of Wisdom tonight. The 2D Zelda games are some of my favorite games of all time.
I was worried about the game’s overall look. It looked too much like Link’s Awakening, which I wasn’t a fan of compared to the GameBoy version.
I’m happy to say the screenshots don’t do the game justice. They perfected their 2D engine and included some camera control, which helps prevent disappearing into the shadows and behind objects.
The game feels like a sequel to 90s SNES A Link to the Past game with some features from the more recent Switch 3D Zeldas and lore. They even built off of the original Zelda’s 2D dungeon side-scrolling mode in a way that I thought was a lot of fun without dreading it.
While I’m happy to see Zelda finally get her own game, I thought the character had a lot of depth and one of the most interesting sets of powers and echoes, which allows for a dizzyingly large number of monsters and objects that Zelda can conjure on demand.
My only complaint was that I snagged a Lynel within the first few hours of play, but I only had enough power right before the last battle of the game to conjure it.
I’m happy that they thought out post-ending gameplay to make finding everything you missed easier, which was refreshing, instead of being stuck in a weird state.
Echoes of Wisdom might be my favorite 2D(ish) Zelda game and one of my favorite Zelda games.
I hope Nintendo lets Grezzo, the game studio behind it, continue to make weird, 2D Zelda games. This game makes me want to explore the studio’s other Nintendo 3DS Zelda games that I missed out on.
-
Django
,Python
,LLM
🤖 I released files-to-claude-xml and new development workflows
After months of using and sharing this tool via a private gist, I finally carved out some time to release files-to-claude-xml.
Despite my social media timeline declaring LLMs dead earlier today, I have used Claude Projects and Artifacts.
My workflow is to copy a few files into a Claude Project and then create a new chat thread where Claude will help me write tests or build out a few features.
My
files-to-claude-xml
script grew out of some research I did where I stumbled on their Essential tips for long context prompts which documents how to get around some file upload limits which encourages uploading one big file using Claude’s XML-like format.With
files-to-claude-xml
, I build a list of files that I want to import into a Claude Project. Then, I run it to generate a_claude.xml
file, which I drag into Claude. I create a new conversation thread per feature, then copy the finished artifacts out of Claude once my feature or thread is complete.After the feature is complete, I delete the
_claude.xml
file from my project and replace it with an updated copy after I re-runfiles-to-claude-xml
.Features on the go
One bonus of using Claude Projects is that once everything is uploaded, I can use the Claude iOS app as a sort-of notes app and development tool. I can start parallel conversation threads and have it work on new ideas and features. Once I get back to my desktop, I can pull these chat conversations up, and if I like the direction of the feature, I might use them. If not, I have wasted no time or effort on them. This also serves as a nice ToDo list.
New workflows
I am working on side projects further using this methodology. Sometimes, I would like to work on something casually while watching Netflix, but my brain shuts off from coding during the day. Instead of feeling bad that I haven’t added share links to a website or some feature I meant to add last week, I can pair Claude to work on it with me.
I can also get more done with my lunch hours on projects like DjangoTV than I could have otherwise. Overall, I’m happy to have an on-demand assistant to pair with and work on new features and ideas.
It’s also quicker to try out new ideas and projects that I would have needed to make time for.
Alternatives
Simon Willison wrote files-to-prompt, which I think is also worth trying. I contributed to the discussion, feedback, and document structure for the
--cxml
feature.I wrote
files-to-claude-xml
before Simon had cxml support and hoped to not release my version.However, after trying it out on several projects, my ignore/exclude list grew more significant than the files that I wanted to include in my project to send to Claude. I found it easier to generate a list of files to pass to mine instead of maintaining a long list to exclude.
-
Shows
📺 Bad Monkey
I went in with zero expectations and enjoyed Bad Monkey. The show was fun in one of those narrated 80s detective shows. I am not sure that I am or am not a Vince Vaughn fan, but it is the best role I have seen him.
-
Office Hours
📅 Office Hours for October
This Friday, I am hosting office hours, and here is our schedule for October.
- Friday, October 11th, 2024 2:30 pm to 4:30 pm
- Friday, October 18th, 2024 - No office hours
- Friday, October 25th, 2024 2:30 pm to 4:30 pm
High-level details
ℹ️ Anyone can join office hours. Many join because they work remotely, miss seeing faces, and miss the random conversations when a small group hangs out.
ℹ️ Our office hours are a collaborative space where we can discuss our ongoing projects, catch up, and work together to wrap up our week on a productive note.
🙏 As always, everyone is welcome to join, whether you’re a regular attendee or joining for the first time. If you are curious, reach out.
✅ If you need any additional details, feel free to send me a message or check out the gist from our previous sessions, where you’ll always find the most recent Zoom link ⚠️
-
Django
,Python
,UV
⚙️ UV with GitHub Actions to run an RSS to README project
For my personal GitHub profile, I list my activities, affiliations, and the latest updates from some of my projects.
Historically, I have used JasonEtco/rss-to-readme GitHub Action to fetch a few RSS feeds or two and to update my README a few times a day.
Overall, I’m happy with this setup. I used it on the Django News GitHub Organization to pull in newsletter issues, jobs, and the latest videos from our various projects. When I tried to install rss-to-readme in our repo, I was getting node12 errors. (Have I mentioned how much I loathe node/npm?).
Instead of forking rss-to-readme and trying to figure out how to upgrade it, I used this as an excuse to “pair program” with Claude. We quickly built out a prototype using Python and the feedparser library.
I would share the chat log, but it’s mostly me trying out a few different ways to invoke it before I settle on the finished approach. See the source code over on GitHub if you are curious: https://github.com/django-news/.github/blob/main/fetch-rss.py
Once I had a working Python script that could fetch an RSS file and modify the README, I decided to run/deploy it using UV to see how minimal I could build out the GitHub Action.
GitHub Action
To run our
fetch-rss.py
script, we have four steps:actions/checkout
Get a git checkout of our project.astral-sh/setup-uv
Setup UV also installs Pythons for us. As a bonus, we enabled UV’s cache support, which will run much faster in the future unless we change something in our fetch-rss.py file.- Run
uv run fetch-rss.py ...
to fetch our RSS feeds and write them to disk.uv run
installs any dependencies and caches them before ourfetch-rss.py
runs. stefanzweifel/git-auto-commit-action
If our README.md file has changed, save our changes and commit them back to git and into our README.
Our
schedule.yml
GitHub Action workflow runs twice daily or whenever we push a new change to our repo. We also setworkflow_dispatch,
which gives us a button to run the script manually.# .github/workflows/schedule.yml name: Update README on: push: branches: - main schedule: # Once a day at 12 AM - cron: 0 12 * * * workflow_dispatch: jobs: update: runs-on: ubuntu-latest permissions: contents: write steps: - uses: actions/checkout@v4 - name: Install uv uses: astral-sh/setup-uv@v3 with: enable-cache: true cache-dependency-glob: | *.py - name: Fetch our Feeds run: | # Fetch latest Django News Newsletter entries uv run fetch-rss.py \ --section=news \ --readme-path=profile/README.md \ https://django-news.com/issues.rss - uses: stefanzweifel/git-auto-commit-action@v5 with: commit_message: ":pencil: Updates README"
Results
Overall, I’m pleased with this solution. If I wanted to spend more time on it or re-use this workflow, I might turn it into a GitHub Action workflow so that we can call:
django-news/rss-to-readme
to use in other projects. For now, this is fine.I’m happy with the
astral-sh/setup-uv
anduv run
steps because they save me from having to set up Python and then install our project dependencies as separate steps.I normally shy away from running Python workflows like this in GitHub Actions because they involve a lot of slow steps. This entire workflow takes 16 to 20 seconds to run, which feels fast to me.
-
Django
,Python
🎉 Announcing DjangoTV
Friends, I’m launching a half-finished website idea that I have been playing around with for a while. djangotv.com is focused on promoting and searching Django videos to make discovery easier.
I wanted to launch DjangoTV before I left DjangoCon US 2024, so I’m technically announcing it from the airport. Last year, I launched Django News Jobs during the Django sprints because I was annoyed by the state of the various Django job boards.
After a year of hearing people complain about Django and Python YouTube videos not getting enough views, I decided to address the problem by building out a website to help organize and promote them.
DjangoTV is not competing with pyvideo.org. PyVideo is a fantastic resource for the Python community, and one of my goals is to make it easier to get Django content on PyVideo, too.
DjangoTV is incomplete, and I have many ideas to improve it, including backfilling some of our older conferences, adding presenters, and adding some other metadata to make it a useful community resource.
I focused on DjangoCon videos to bootstrap the project, and we’ll slowly expand our archives. I have been extracting good quotes, adding transcriptions, and adding better summaries. Please expect this to change a lot. I even launched the website with DEBUG turned on for a few days before I turned it off.
Your feedback is crucial to us. If you have any ideas or suggestions, please don’t hesitate to share them.
Most importantly, names change, people change, and bodies change. It’s essential to me that we respect each other and handle this with care. If you have a concern or need us to pull a video, please don’t hesitate to reach out; we will take care of it.
-
Django
,Python
,Today I Learned
🧳 DjangoCon US, Black Python Devs Leadership Summit, and Django Girls Durham
I’m heading to Durham, NC, for seven days of DjangoCon US this Friday. This is my 10th year volunteering and the 9th year that DEFNA, the non-profit I co-founded, has run a DjangoCon US event. Here is an overview of the week.
Black Python Devs Leadership Summit (Saturday)
I’m attending and speaking on a discussion panel on Saturday at the Black Python Devs Leadership Summit. Tickets are free, and they will be streaming online in the afternoon. Donations are accepted and appreciated.
Django Girls Durham (Saturday)
Django Girls are hosting a Django workshop and teaching beginners a crash course on building their first website using Django.
DjangoCon US Tutorials (Sunday)
On Sunday morning, I’ll be volunteering and helping out at the tutorials. In the afternoon, we have a tradition of stuffing swag bags, which takes a big group and is a fun way to kick off the conference. You do not need a tutorial ticket or an organizer to help out. Ask at the registration desk, and they can direct you to when and where we are doing this.
Django Social meetup (Sunday)
My company REVSYS is sponsoring a DjangoSocial Raleigh/Durham Pre-DjangoCon Special meetup on Sunday evening before the conference kicks off. The meetup will be great for meeting other attendees the night before the conference.
DjangoCon US Talks (Monday through Wednesday)
The talks are great, but the busiest three days of the conference are also the busiest. There is always a lot going on, from sun up to sun down.
DjangoCon US Sprints (Thursday and Friday)
The sprints are one of my favorite parts of the conference. In past years, I have been so exhausted by the sprints that it’s hard to sit down and focus. It’s one of the best times to discuss Django and the Django ecosystem. If you have a project or want to find a project to help with, the sprints are great for getting your feet wet.
Outro
Tickets are still available if you live near Durham and want to attend. Both events have online and in-person options, so there is no pressure to make last-minute travel plans.
If you live around Durham and want to meet up, please reach out. Let’s see if we can meet for coffee.
-
Django
,Python
,UV
,Today I Learned
🤠 UV Roundup: Five good articles and a pre-commit tip
I have written quite a bit about UV on my micro blog, and I am happy to see more and more people adopt it. I have stumbled on so many good articles recently that I wanted to share them because every article points out something new or different about why UV works well for them.
If you are new to UV, it’s a new tool written by Astral, the creators of Ruff.
I like UV because it replaces, combines, or complements a bunch of Python tools into one tool and user developer experience without forcing a UV way of doing it. UV effectively solves the question, “Why do I need another Python tool?” to do everyday Python tasks.
Some reason I like UV after using it for months:
- It’s a faster pip and is really, really fast
- It can install and manage Python versions
- It can run and install Python scripts
- It can run single-file Python scripts along with their dependencies
- It can handle project lock files
While some people don’t care about UV being fast, it’s shaved minutes off my CI builds and container rebuilds, which means it has also saved me money and energy resources.
Overall thoughts on UV
Oliver Andrich’s UV — I am (somewhat) sold takes the approach of only using UV to set up a new Python environment. Oliver uses UV to install Python, aliases to call Python, and UV tool install to set up a few global utilities.
Using UV with Django
Anže Pečar’s UV with Django shows how to use UV to set up a new project with Django.
Switching from pyenv to UV
Will Guaraldi Kahn-Greene’s Switching from pyenv to uv was relatable for me because I also use pyenv, but I plan to slowly migrate to using only UV. I’m already halfway there, but I will have pyenv for my legacy projects for years because many aren’t worth porting yet.
Using UV and managing with Ansible
Adam Johnson’s Python: my new uv setup for development taught me to use
uv cache prune
to clean up unused cache entries and shows how he manages his UV setup using Ansible.Some notes on UV
Simon Willison’s Notes on UV is an excellent summary of Oliver’s notes.
A parting UV tip
If you are a pre-commit fan hoping for a version that supports UV, the
pre-commit-uv
project does just that. I started updating my justfile recipes to bakejust lint
to the followinguv run
command, which speeds up running and installing pre-commit significantly.$ uv run --with pre-commit-uv pre-commit run --all-files pre-commit-uv
If you are attending DjangoCon US…
If you are attending DjangoCon US and want to talk UV, Django, Django News, Django Packages, hit me up while you are there.
I’ll be attending, volunteering, organizing, sponsoring, and sprinting around the venue in Durham, NC, for the next week starting this Friday.
We still have online and in-person tickets, but not much longer!
-
Django
,Python
,Office Hours
📅 Office Hours Fall Update
This Friday, I am hosting Office Hours before I travel to DjangoCon US (organizer) and the Black Python Devs Leadership Summit (speaker) in Durham, NC.
This Friday will be my last session before a two-week break, but I will resume Office Hours again on October 4th.
- Friday, September 13th, 2024, 2:30 pm to 4:30 pm
- Friday, September 20th, 2024 - No office hours
- Friday, September 27th, 2024 - No office hours
- Friday, October 4th, 2024, 2:30 pm to 4:30 pm
High-level details
ℹ️ Anyone can join office hours. Many join because they work remotely, miss seeing faces, and miss the random conversations when a small group hangs out.
ℹ️ Our office hours are a collaborative space where we can discuss our ongoing projects, catch up, and work together to wrap up our week on a productive note.
🙏 As always, everyone is welcome to join, whether you’re a regular attendee or joining for the first time. If you are curious, reach out.
✅ If you need any additional details, feel free to send me a message or check out the gist from our previous sessions, where you’ll always find the most recent Zoom link ⚠️
-
🛌 On travel tips BYOP aka bring your own pillow
🎒 While some of my friends and colleagues can pack everything they need in a small backpack for a week’s travel, I am not that person.
I turned into the person who brings their pillow when they travel, and it changed my stay and quality of sleep by 1000%.
There are many variables you can’t control when you travel, but the pillow is the one variable I can control, and it has the biggest impact on my overall sleep quality. It’s frustrating to pay $200 or more a night for a nice hotel room and then to have a lousy night of sleep because of a flat pillow.
You can’t control the mattress quality you sleep on, but having a decent pillow takes the edge off for me.
It’s also an excellent excuse to buy a new pillow for your home in case your bag gets damaged, something happens to your pillow, and you need to throw your old pillow away. That also eases the burden so you can throw your travel pillow in the wash as soon as you get back without disrupting your first night back home.
In conclusion, you can bring your own pillow if you struggle with sleep while traveling. It’s a relatively cheap life hack that might require a slightly bigger bag, but it might be worth it for improved sleep quality.
-
Django
,Today I Learned
🚜 On Evolving Django's `auth.User` model
I need to re-read/re-listen to Carlton’s Evolving Django’s
auth.User
Stack Report before I have a firm opinion, but I saw his Mastodon post and I thought it was worth sharing some initial thoughts.On my first read, I fell into the camp that wants
django-unique-user-email
and full name to be the defaults on Django’s built-in User. I have wanted this forever, and my clients do, too.Django should still allow me to create a custom user, but the documentation could be better. Django’s documentation is a topic for another day, but I’m confused by it and find it less and less helpful. I notice the developers I work with get lost in them, too. Docs may be a good DjangoCon US topic if you want to discuss it in a few weeks.
I would love the default User to have a unique email address, full name, and a short name. Optionally, a username is an email address setting. Please don’t take away the ability to have a custom User model. (Update: Carlton is not making a case for removing a custom User model, but others have made that argument. No, thank you.)
Carlton’s “Action points” conclusion seems reasonable to me.
-
Django
,Python
🚫 Stop scheduling security updates and deprecating major features over holidays
I know people outside the US 🙄 at this, but please stop releasing major security updates and backward incompatible changes over major US, international, and religious holidays.
Given that major security updates are embargoed and scheduled weeks and months in advance, it’s essential to coordinate and avoid conflicts. A simple check of the calendar before scheduling announcements can prevent such issues.
Even if you give everyone two weeks' notice, aka what GitHub just did, wait to schedule them for release over a holiday weekend.
Historically, the Python and Django communities have also been guilty of this, so I’m not just finger-pointing at GitHub. We can all do better here.
Update: 100% unrelated to this: Django security releases issued: 5.1.1, 5.0.9, and 4.2.16. Thank you, Natalia (and Sarah) for scheduling this after the US is back from a major holiday.
-
Today I Learned
🌡️ How a $20 Camera Outsmarted My Fancy Thermometer
My ThermoWorks Signals thermometer’s battery was dead, so I connected it to my Anker 737 Power Bank (24,000mAh for the curious) to get me by.
Previously, I mounted a Wyze camera on a tripod and pointed it toward my thermometer because its Bluetooth connection wasn’t strong enough. WiFi worked fine for the camera, but our smoker is in our backyard and has to go through two external walls to reach any of our devices.
This worked well during the early pandemic when I was working from home. I could check the camera from my upstairs office or couch without worrying about the weather. As a bonus, I could see the front panel of my Pitbos Smoker to monitor it in case it ran out of wood pellets or the heat source went out. I could have bought the fancy ThermoWorks Signals thermometer, but a $20 Wyze Camera worked better.
Today, I have the fancy thermometer, and I still should have connected the Wyze cam because the smoker ran out of pellets, which delayed dinner by 45 minutes.
Maybe I will use this as an excuse to explore one of Ollama’s Vision libraries like LLaVA to read photos from the Wyze Camera and the smoker to let me know when something goes wrong.
-
Django
,Python
,UV
🚜 Using Claude 3.5 Sonnet to refactor one of Brian Okken's Python projects
Brian Okken posted and published his Top pytest Plugins script and then a follow-up post, Finding the top pytest plugins, which was pretty cool.
I have written a few throw-away scripts, which William Vincent wrote about and updated a few times in the Top 10 Django Third-Party Packages (2024) and The 10 Most-Used Django Packages (2024).
These efforts are powered by Hugo van Kemenade’s excellent Top PyPI Packages.
This inspired me to fork Brian’s top-pytest-plugins project, which I updated to support passing in other package names like “django” to get a rough estimate of monthly package downloads.
The refactored project is jefftriplett/top-python-packages.
Please note: Looking at the package name doesn’t scale as well for projects that have their own Trove classifiers. For a project like pytest, it works well. Many of the top packages may not even have Django in their name for a project like Django. Some projects may even actively discourage a project from using their project in their package’s name for trademark reasons. So, YMMV applies here.
Prompts
I added
uv run
support, which I have written about a lot lately.I also copied the
top_pytest.py
file into a Claude 3.5 Sonnet session, and I let it handle the whole refactor. It even handled adding the PEP 723 new package dependencies without me asking it to.In case it’s useful to anyone, here are my prompts:
## Prompt: Please update this script to use a rich table. ## Prompt: Please update the table styles to be ascii so I can copy and paste it into a markdown doc ## Prompt: Please remove the description column ## Prompt: Please change all PyTest and pytest references to Django and django ## Prompt: Please add back `if 'django' in project.lower() and 'django' != project.lower():` ## Prompt: please remove the \*# Export to markdown section. I can just pipe the output \* ## Prompt: Please add the typer library. ## Prompt: Please remove days and limit ## Prompt: Please refactor the script to allow me to pass the package name instead of django. You can default to django though. This way I can pass pytest or flask or other projects. ## Prompt: Please change the default Table box type to MARKDOWN
Outro
I don’t usually write about Claude or prompts, but the tool has been handy lately.
If you have had some similar successes, let me know. I have been exploring some rabbit holes, and it’s changing the way I approach solving problems.
-
Django
,Python
,UV
,Today I Learned
📓 UV Run Django Notes
I wanted to know how hard it would be to turn one of my django-startproject projects into a
uv run
friendly project. As it turns out, it worked, and the steps were more than reasonable.Before the PEP 723’ing…
I started with a fairly vanilla
manage.py
that Django will give you after runningpython -m manage startproject
."""Django's command-line utility for administrative tasks.""" import os import sys def main(): """Run administrative tasks.""" os.environ.setdefault("DJANGO_SETTINGS_MODULE", "config.settings") try: from django.core.management import execute_from_command_line except ImportError as exc: raise ImportError( "Couldn't import Django. Are you sure it's installed and " "available on your PYTHONPATH environment variable? Did you " "forget to activate a virtual environment?" ) from exc execute_from_command_line(sys.argv) if __name__ == "__main__": main()
shebang
Then we add
#!/usr/bin/env -S uv run
to the top of ourmanage.py
file.Next, we make our
manage.py
executable and try to run it.$ chmod +x manage.py $ ./manage.py ModuleNotFoundError: No module named 'django'
Our script ran, but Python couldn’t find Django. To tell our script to install Django, we can use
uv add—- script
to add it.$ uv add --script manage.py django Updated `manage.py` $ ./manage.py ... Type 'manage.py help <subcommand>' for help on a specific subcommand. Available subcommands: [django] check compilemessages createcachetable dbshell diffsettings dumpdata flush inspectdb loaddata makemessages makemigrations migrate optimizemigration runserver sendtestemail shell showmigrations sqlflush sqlmigrate sqlsequencereset squashmigrations startapp startproject test testserver Note that only Django core commands are listed as settings are not properly configured (error: No module named 'environs').
Django worked as expected this time, but Python could not find a few third-party libraries I like to include in my projects.
To add these, I passed the other four to
uv add --script
which will add them to the project.$ uv add --script manage.py django-click "environs[django]" psycopg2-binary whitenoise Updated `manage.py` ... $ ./manage.py ...
Our Django app’s
manage.py
works when we run it.After the PEP 723’ing…
After we installed our dependencies in our
manage.py
file, they were added to the top of the file between the///
blocks.#!/usr/bin/env -S uv run # /// script # requires-python = ">=3.10" # dependencies = [ # "django", # "django-click", # "environs[django]", # "psycopg2-binary", # "whitenoise", # ] # /// """Django's command-line utility for administrative tasks.""" import os import sys def main(): """Run administrative tasks.""" os.environ.setdefault("DJANGO_SETTINGS_MODULE", "config.settings") try: from django.core.management import execute_from_command_line except ImportError as exc: raise ImportError( "Couldn't import Django. Are you sure it's installed and " "available on your PYTHONPATH environment variable? Did you " "forget to activate a virtual environment?" ) from exc execute_from_command_line(sys.argv) if __name__ == "__main__": main()
-
Python
,UV
🐍 Python UV run with shebangs
This UV shebang trick that Simon Willison linked up is a nice pattern, and I plan to rebuild some of my one-off scripts in my dotfiles using it.
Here is a demo that will print “hello python” using the Python Branding colors using the Rich library while letting UV install and manage rich for you.
#!/usr/bin/env -S uv run # /// script # requires-python = ">=3.10" # dependencies = [ # "rich", # ] # /// from rich.console import Console from rich.theme import Theme python_theme = Theme( { "pyyellow": "#ffde57", "pyblue": "#4584b6", } ) console = Console(theme=python_theme) console.print("[pyyellow]hello[/pyyellow] [pyblue]python[/pyblue]", style="on #646464")
Assuming you have UV installed, and you save and
chmod +x
this file ashello-python.py
, then you should be able to run it via./hello-python.py.
I suspect I can more easily bootstrap new machines using this trick without fewer worries about polluting my global system packages.
-
Python
,UV
🐍 UV Updates and PEP 723: Simplifying Python Packaging and Scripting
The uv: Unified Python packaging update brings fresh air to the Python community, with several improvements streamlining the development process. One exciting addition is an early preview of PEP 723, also known as Single-file scripts.
The Single-file scripts feature particularly caught my attention due to its potential to simplify the distribution and execution of small Python projects. Streamlining the process is highly appealing to someone who frequently creates GitHub Gists and shares them privately and publicly.
With this new feature, I can now instruct users to run
uv run main.py
without explaining what avenv
orvirtualenv
is, plus a long list of requirements that need to be passed topip install
.I had the opportunity to test this feature over lunch today. While adding libraries to the script was straightforward, I encountered a few hurdles when I forgot to invoke
uv run
in my virtual environment (venv). This makes sense, given that it’s a new habit, but it highlights the importance of adapting to changes in our development workflow.Overall, the UV: Unified Python packaging update and the introduction of Single-file scripts mark a significant step in simplifying Python development. As developers become more familiar with these improvements, we expect increased adoption and smoother collaboration on small-scale projects.
Bonus Example
I looked through some of my recent visits, and one I recently shared with a few conference organizer friends was a one-off script I used to read several YouTube video JSON files that I’m using to bootstrap another project. It was the first time I used DuckDB to make quick work of reading data from a bunch of JSON files using SQL.
Overall, I was happy with DuckDB and what PEP 723 might bring to the future of Python apps, even if my example only does a little.
# To run this application, use: # uv run demo-duckdb.py # # /// script # requires-python = ">=3.10" # dependencies = [ # "duckdb", # "rich", # "typer", # ] # /// import duckdb import typer from rich import print def main(): result = duckdb.sql("SELECT id,snippet FROM read_json('json/*.json')").fetchall() for row in result: id, snippet = row print("-" * 80) print(f"{id=}") print(f"{snippet['channelTitle']=}") print(f"{snippet['title']=}") print(f"{snippet['publishedAt']=}") print(snippet["description"]) print(snippet["thumbnails"].get("maxres") or snippet.get("standard")) print() if __name__ == "__main__": typer.run(main)
Overall, the future is bright with UV and PEP 723 may bring us. I’m excited to have more one-file Python apps that are easier to share and run with others.
PEP 723 also opens the door to turning a one-file Python script into a runnable Docker image that doesn’t even need Python on the machine or opens the door for Beeware and Briefcase to build standalone apps.
-
Enshittification
🔥 Breaking Up Google
Here are my thoughts on John Gruber’s recent article and notes on the Google Monopoly.
I mean, let’s say Google was forced to spin Chrome off. How would Chrome Inc. make money? Clearly, they’d make money through TAC fee payments from Google search. >Also, if they split off Chrome they’d almost have to split off Android.
Chrome Inc will be quite profitable, making $20 billion a year from Alphabet to set Google Search as the default search engine on Chrome. The same model works for Android Inc, too.
The Justice Department doesn’t exist to figure out Alphabet’s business model nor does it care to. The fact that everything is so tied together that it’s hard to split up doesn’t is only further proof that Google is a monopoly.
If Google is disallowed from making its own web browser how in the world can they make an OS? I mean in theory they could make an OS that only offered third-party browsers but that would mean no system-level webview for apps to embed. Some people laughed at Microsoft’s late-1990s argument that Windows needed a built-in browser but that’s obviously true today. It’s no different than including a TCP/IP networking stack or printer drivers.
The OS which is Linux based can go with Chrome. Google doesn’t need their own OS to work on Mac, iOS, Windows, and other operating system they run their products on.
I don’t know what the remedy ought to be for this case, but I don’t think a breakup is it.
A breakup is better for consumers. Google’s stranglehold on the online ad industry will feel painful after it’s broken up. The only reason it feels hard to break Google into so many new companies is because it’s such a one-sided monopoly. However, that doesn’t justify not breaking them up.
Google has a long history of pushing technology that is only good for Google. Does anyone remember AMP and how Google forced the publishing industry to jump to a platform that only benefited them?
It makes sense to chop Alphabet + Google into dozens of smaller companies. Chrome, Android, Gmail, Docs (maybe Maps), and hardware should stand independently. Search and Ads should each be divided into multiple companies. The goal isn’t to make business sense; it is to divide the company into parts that compete against themselves.
-
Music
,Today I Learned
🎻 Tiny Desk Concert Wednesday with Sierra Ferrell
🎻 Happy Tiny Desk Concert Wednesday, everyone!
If you are new to Sierra Ferrell, you are in a treat.
If you are already a fan, you’ll understand what I mean and still be in for a treat.
I dislike Google but make exceptions for NPR, Tiny Desk Concert, and Sierra Ferrell.
-
Django
,Python
,Office Hours
💼 Office Hours this Friday, August 9th
I am hosting Office Hours this Friday, August 9th, 2024, from 2:30 pm to 4:30 pm Central Time.
💼 I plan to upgrade some projects to work with Django 5.1 and possibly Python 3.13 as time permits. I have a few Django Packages tasks to finish too.
ℹ️ Anyone can join office hours.
ℹ️ Our office hours are a collaborative space where we can discuss our ongoing projects, catch up, and work together to wrap up our week on a productive note.
🙏 As always, everyone is welcome to join, whether you’re a regular attendee or joining for the first time.
✅ If you need any additional details, feel free to send me a message or check out the gist from our previous sessions, where you’ll find the Zoom link ⚠️
I look forward to seeing everyone.