From 44f4b5feeee543495b7ef03d2d7b1368556912a3 Mon Sep 17 00:00:00 2001 From: David Wagner Date: Sat, 3 Aug 2024 11:42:31 +0200 Subject: [PATCH] Add post: Raspberry Pi camera on NixOS --- ...4-07-31-Raspberry-Pi-Camera-NixOS.markdown | 201 ++++++++++++++++++ 1 file changed, 201 insertions(+) create mode 100644 content/2024-07-31-Raspberry-Pi-Camera-NixOS.markdown diff --git a/content/2024-07-31-Raspberry-Pi-Camera-NixOS.markdown b/content/2024-07-31-Raspberry-Pi-Camera-NixOS.markdown new file mode 100644 index 00000000..51e6d2a8 --- /dev/null +++ b/content/2024-07-31-Raspberry-Pi-Camera-NixOS.markdown @@ -0,0 +1,201 @@ +--- +title: Raspberry Pi camera on NixOS +--- + +In this article, I describe how I configured my Raspberry Pi V1 camera module on +my Raspberry Pi 3 running NixOS. + +The Raspberry Pi OS has [excellent support][RPi-Camera-Configuration] for many +camera modules. If you run the officially supported operating system, most +cameras work without any further configuration. + +In my [Homelab][Homelab] I don't use the Raspberry Pi OS, but I run NixOS on all +my computers, including the Raspberry Pi. NixOS works well on the Pi, but the +camera module I own needs a special configuration. + +# The "new" camera stack + +Four years ago, the Raspberry Pi team [released a new camera +stack][libcameraAnnouncement] that provides better access to the internals of +the camera system. Today, the old stack using Broadcom proprietary software is +unsupported and obsolete. Unfortunately, many online instructions and tutorials +[still refer to the Broadcom stack][CameraNotDetected] which renders them +irrelevant to the modern camera stack. + +The new camera stack comprises four layers: + +1. Linux kernel with board-specific configuration +1. Camera-specific drivers +1. The libcamera library +1. rpicam-apps camera utilities for taking photos and videos + +The next sections describe how I configured these components on NixOS to use a +Raspberry Pi Version 1 camera module (Omnivision OV5647) with my Raspberry Pi +3B. + +## Kernel + +The official NixOS installer works well on the Raspberry Pi. But the camera +modules require some subsystems which are not enabled by default. + +Fortunately, it's easy to switch to a kernel tailored to the Raspberry Pi. For +my Raspberry Pi 3B, I select the `linux_rp3` kernel package: + +``` +{ pkgs, ...}: +{ + boot.kernelPackages = pkgs.linuxKernel.packages.linux_rpi3; +} +``` + +Actually, I don't adjust this parameter in [my configuration][HomelabHostRpi3], +but I import the `raspberry-pi-3` module from +[nixos-hardware][NixOSHardwareRPi3] which selects the correct kernel and tunes +a few other parameters too. + +## Camera driver (OV5647) + +The Raspberry Pi v1 camera module uses an Omnivision OV5647 image sensor. We +need to describe the OV5647 hardware to the kernel so that the sensor can be +controlled via the respective system calls. The data structure and language +for describing hardware is called the _device tree_. + +The NixOS configuration block that enables the image sensor reads as follows: + +``` +{ pkgs, ...}: +{ + hardware.deviceTree.filter = "bcm2837-rpi-3*"; + hardware.deviceTree.overlays = [ + name = "ov5647-overlay"; + dtsText = ''' + ...ELIDED... + '''; + ] +} +``` + +For brevity, I omitted the value of the `dtsText`. In my Homelab repository you +can read the full [device tree overlay configuration][HomelabDeviceTreeOverlay]. + +The `dtsText` string is a copy of the file +[ov5467-overlay.dts][ov5467-overlay.dts] from the Linux kernel source with the +one modification: I changed the `compatible` property from `bcm2835` to +`bcm2837`. It turns out the OV546 device tree overlay is compatible with both +BCM chipsets, but I don't understand why overlay's source doesn't reflect this. + +I learned about this technique in [a GitHub issue +comment](https://github.com/NixOS/nixpkgs/issues/125354). It works™, the kernel +recognizes the image sensor on the I2C bus: + +``` +$ cat /sys/bus/i2c/devices/10-0036/name +ov5647 +``` + +It was hard to get the device tree overlay working, but I'm not entirely +satisfied with the result. Fiddling with the device tree source files doesn't +feel right. + +Fortunately, we're done with the hardware configuration. Next, the software +stack. + +## libcamera + +The libcamera library drives the Raspberry Pi's camera system directly from +the Linux kernel, with minimal proprietary running on the Broadcom GPU. + +libcamera is part of [nixpkgs][NixpkgsLibcamera], but it's built without +support for the Raspberry Pi. I developed a [Nix package +overlay][HomelabLibcamera], based on the [Raspberry Pi specific libcamera +instructions][BuildLibcamera], which the compiles libcamera with a few +additional flags: + +``` +mesonFlags = old.mesonFlags ++ [ + "-Dcam=disabled" + "-Dgstreamer=disabled" + "-Dipas=rpi/vc4,rpi/pisp" + "-Dpipelines=rpi/vc4,rpi/pisp" +]; +``` + +The upstream libcamera package uses the Meson build system. In the previous +snippet, `old.mesonFlags` refers to the upstream package's build flags. The +overlay appends to the original flag list enabling the Raspberry Pi specific +Image Processing Algorithms (IPAs) and pipelines. + +This example shows off the strength of the Nix Packages overlay systems: the +overlay describes the differences from the upstream package's build +instructions, like a _patch_ representing the differences between two versions +of a text file. + +## rpicam-apps + +rpicam-apps is a set of command line applications, built on top of libcamera, +to capture images and video from a Raspberry Pi camera. + +Based on a [draft pull-request in nixpkgs][NixpkgsLibcameraPR], I wrote [a Nix +derivation][HomelabRpicamApps] which builds rpicam-apps using my own libcamera +build and enabling only a minimal set of features. For example, I deactivate +support for preview windows and advanced post-processing capabilities. + +# Picture time + +I collected the configuration I described in the previous sections in a [NixOS +module][HomelabCameraModule] which is imported from my [Raspberry Pi 3 host +configuration][HomelabHostRpi3]. + +After the configuration is deployed on the device, I can list the available +cameras: + +``` text +$ rpicam-still --list-cameras +Available cameras +----------------- +0 : ov5647 [2592x1944 10-bit GBRG] (/base/soc/i2c0mux/i2c@1/ov5647@36) + Modes: 'SGBRG10_CSI2P' : 640x480 [58.92 fps - (16, 0)/2560x1920 crop] + 1296x972 [43.25 fps - (0, 0)/2592x1944 crop] + 1920x1080 [30.62 fps - (348, 434)/1928x1080 crop] + 2592x1944 [15.63 fps - (0, 0)/2592x1944 crop] +``` + +And, of course, I can take pictures: + +``` +rpicam-still --output test-image.jpg +``` + +INSERT IMAGE HERE + +I'm trying to to impress you with the image quality. The v1 camera module was +[released in 2013][v1Release], the modules available today have much better +sensors and optics. + +# Summary + +I use NixOS because the operating system is described in a declarative +configuration. The camera specific modifications I described in this article +are in a [NixOS module][HomelabCameraModule] which is included in my Raspberry +Pi's [host configuration][HomelabHostRpi3]. + +By choosing NixOS over the official Raspberry Pi OS, I set myself up to an +arduous journey. But, I learned about details of the camera stack, and now I +appreciate more the integration work done by the Raspberry Pi Foundation. + +[BuildLibcamera]: https://www.raspberrypi.com/documentation/computers/camera_software.html#build-libcamera-and-rpicam-apps +[CameraNotDetected]: https://forums.raspberrypi.com/viewtopic.php?t=362707 +[HomelabCameraModule]: https://github.com/wagdav/homelab/blob/master/modules/camera-rpi-v1/default.nix +[HomelabDeviceTreeOverlay]: https://github.com/wagdav/homelab/blob/master/modules/camera-rpi-v1/default.nix#L34 +[HomelabHostRpi3]: https://github.com/wagdav/homelab/blob/master/host-rp3.nix +[Homelab]: https://github.com/wagdav/homelab +[HomelabRpicamApps]: https://github.com/wagdav/homelab/blob/master/modules/camera-rpi-v1/rpicam-apps.nix +[HomelabLibcamera]: https://github.com/wagdav/homelab/blob/master/modules/camera-rpi-v1/overlays/libcamera.nix +[libcameraAnnouncement]: https://www.raspberrypi.com/news/an-open-source-camera-stack-for-raspberry-pi-using-libcamera/ +[NixOSHardwareRPi3]: https://github.com/NixOS/nixos-hardware/blob/a59f00f5ac65b19382617ba00f360f8bc07ed3ac/raspberry-pi/3/default.nix#L7 +[NixpkgsLibcamera]: https://github.com/NixOS/nixpkgs/blob/4b616a8ecce7aaceea5360f9724065c182dc016f/pkgs/by-name/li/libcamera/package.nix +[NixpkgsLibcameraPR]: https://github.com/NixOS/nixpkgs/pull/281803 +[NixWikiCamera]: https://wiki.nixos.org/wiki/NixOS_on_ARM/Raspberry_Pi#Camera +[RPi-Camera-Configuration]: https://www.raspberrypi.com/documentation/computers/camera_software.html#configuration +[ov5467-overlay.dts]: (https://github.com/raspberrypi/linux/blob/rpi-6.1.y/arch/arm/boot/dts/overlays/ov5647-overlay.dts) +[v1Release]: https://www.raspberrypi.com/news/camera-board-available-for-sale/