Currently I’m planning to dockerize some web applications but I didn’t find a reasonably easy way do create the images to be hosted in my repository so I can pull them on my server.

What I currently have is:

  1. A local computer with a directory where the application that I want to dockerize is located
  2. A “docker server” running Portainer without shell/ssh access
  3. A place where I can upload/host the Docker images and where I can pull the images from on the “Docker server”
  4. Basic knowledge on how to write the needed Dockerfile

What I now need is a sane way to build the images WITHOUT setting up a fully featured Docker environment on the local computer.

Ideally something where I can build the images and upload them but without that something “littering Docker-related files all over my system”.

Something like a VM that resets on every start maybe? So … build the image, upload to repository, close the terminal window, and forget that anything ever happened.

What is YOUR solution to create and upload Docker images in a clean and sane way?

  • orizuru@lemmy.sdf.org
    link
    fedilink
    English
    arrow-up
    10
    ·
    edit-2
    1 year ago

    For the littering part, just type crontab -e and add the following line:

    @daily docker system prune -a -f
    
    • vegetaaaaaaa@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      edit-2
      1 year ago

      Careful this will also delete your unused volumes (not attached to a running container because it is stopped for whatever reason counts as unused). For this reason alone, always use bind mounts for volumes you care about.

      • orizuru@lemmy.sdf.org
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 year ago

        Yes.

        All my self hosted containers are bound to some volume (since they require reading settings or databases).

        • vegetaaaaaaa@lemmy.world
          link
          fedilink
          English
          arrow-up
          3
          ·
          1 year ago

          run docker without sudo.

          Doing that, you effectively give the user account root access without password

          docker run --volume /etc:/host_etc debian /bin/bash -> can read/write anything below the host’s /etc directory, including shadow file, etc.

          • orizuru@lemmy.sdf.org
            link
            fedilink
            English
            arrow-up
            2
            ·
            edit-2
            1 year ago

            True.

            But I assume OP was already running docker from that user, so they are comfortable with those permissions.

            Maybe should have made it clearer. Added to my other post. Thanks!

      • orizuru@lemmy.sdf.org
        link
        fedilink
        English
        arrow-up
        3
        ·
        edit-2
        1 year ago

        Genuinely curious, what would the advantages be?

        Also, what if the Linux distro does not have systemd?

        • moonpiedumplings@programming.dev
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 year ago

          The chances I am going to manage a linux distro without systemd are low, but some systems (arch for example) don’t have cron out of the box.

          Not that big of a deal since it’s easy to translate them all, but that’s one of the reasons why I default to systemd/timer units.

        • Cyberflunk@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 year ago

          I was just making a meme dude. Personally, I like systemd, it’s more complicated to learn, I ended up reading books to really learn it properly. There’s 100% nothing wrong with cron.

          One of the reasons I like timers is journalctl integration. I can see everything in one place. Small thing.

  • AggressivelyPassive@feddit.de
    link
    fedilink
    English
    arrow-up
    8
    arrow-down
    1
    ·
    1 year ago

    I use Gitea and a Runner to build Docker images from the projects in the git repo. Since I’m lazy and only have one machine, I just run the runner on the target machine and mount the docker socket.

    BTW: If you manage to “litter your system with docker related files” you fundamentally mis-used Docker. That’s exactly what Docker is supposed to prevent.

    • smik@discuss.tchncs.de
      link
      fedilink
      English
      arrow-up
      6
      ·
      1 year ago

      Self hosting your own CI/CD is the key for OP. Littering is solved too because litter is only a problem on long running servers, which is an anti-pattern in a CI/CD environment.

    • 𝘋𝘪𝘳𝘬@lemmy.mlOP
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      I already have Forgejo (soft-fork of Gitea) in a Docker container. I guess I need to check how I can access that exact same Docker server where itself is hosted …

      With littering I mean several docker dotfiles and dotdirectories in the user’s home directory and other system-wide locations. When I installed Docker on my local computer it created various images, containers, and volumes when created an image.

      This is what I want to prevent. Neither do I want nor do I need a fully-featured Docker environment on my local computer.

      • AggressivelyPassive@feddit.de
        link
        fedilink
        English
        arrow-up
        5
        ·
        1 year ago

        Maybe you should read up a bit about how docker works, you seem to misunderstand a lot here.

        For example the “various images” are kind of the point of docker. Images are layered, and each layer is its own image, so you might end up with 3 or 4 images despite only building one image.

        This is something you can’t really prevent. It’s just how docker works.

        Anyway, you can mount the docker socket into a container, and using that socket you can then build an image within the running container. That’s essentially how most ci/cd systems work.

        You could maybe look into podman and buildah, as far as I know, these can build images without a running docker daemon. That might be a tad “cleaner”, but comes with other problems (like no caching).

        • 𝘋𝘪𝘳𝘬@lemmy.mlOP
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 year ago

          I have no problem with Docker creating several images and containers and volumes for building a single-image application. The problem is that it does not clean up afterwards and leaves me with multiple things I don’t need for anything else.

          I also don’t care about caching or any “magic” stuff. I just ideally want to run one command (or script doing it for me) to build an image resulting in just this one image without any other traces left. … I just like a clean environment and the build process ideally being self-contained.

          But I’ll look into your suggestions, thanks!

          • AggressivelyPassive@feddit.de
            link
            fedilink
            English
            arrow-up
            1
            ·
            1 year ago

            I seriously don’t understand what leftovers you’re talking about.

            You essentially have a Dockerfile that describes how you want to build your image, you run docker build with the path of your Dockerfile and the path of the context, and the rest is completely up to you. Docker does not leave that many traces around - only the built images within docker itself, but as I said, that’s the point of building them.

            You can even export the image into a tar file and run docker prune afterwards, that should only leave the exported tar file.

            • 𝘋𝘪𝘳𝘬@lemmy.mlOP
              link
              fedilink
              English
              arrow-up
              1
              ·
              1 year ago

              When I built an image last time there were several unused other images with just hashes as names and two unused volumes, also multiple cache files and other files in the user’s home directory in various subfolders.

      • ffhein@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 year ago

        Do you mean that you want to build the docker image on one computer, export it to a different computer where it’s going to run, and there shouldn’t be any traces of the build process on the first computer? Perhaps it’s possible with the –output option… Otherwise you could write a small script which combines the commands for docker build, export to file, delete local image, and clean up the system.

        • 𝘋𝘪𝘳𝘬@lemmy.mlOP
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 year ago

          I want to export the image to my repository/registry and then use it somewhere else. I also don’t want to set up a complete docker environment with all the “magic” things. Just build an image and upload it.

  • demesisx@infosec.pub
    link
    fedilink
    English
    arrow-up
    7
    ·
    edit-2
    1 year ago

    I build, configure, and deploy them with nix flakes for maximum reproducibility. It’s the way you should be doing it for archival purposes. With this tech, you can rebuild any docker image identically to today’s in 100 years.

    https://youtu.be/0uixRE8xlbY?si=NIIFyzRhXDmcU8Kh

    and here’s a link to a blog post, showing how to create a docker image and rust dev environment.

    https://johns.codes/blog/rust-enviorment-and-docker-build-with-nix-flakes

  • SomeKindaName@lemmy.world
    link
    fedilink
    English
    arrow-up
    6
    ·
    1 year ago

    For local testing: build and run tests on whatever computer I’m developing on.

    For deployment: I have a self hosted gitlab instance in a kubernetes cluster. It comes with a registry all setup. Push the project, let the cicd pipeline build, test, and deploy through staging into prod.

  • Ucinorn@aussie.zone
    link
    fedilink
    English
    arrow-up
    6
    ·
    1 year ago

    Gitlab has a great set of CI tools for deploying docker images, and includes an internal registry of images automatically tied to your repo and available in CI.

  • pbsds@lemmy.ml
    link
    fedilink
    English
    arrow-up
    5
    ·
    edit-2
    1 year ago

    Nix + dockerTools.

    Doesn’t even need docker, and if buitt with flakes I don’t even have to checkout the repo.

  • DefederateLemmyMl@feddit.nl
    link
    fedilink
    English
    arrow-up
    3
    ·
    1 year ago

    VM with a docker build environment.

    As for “littering”, a simple docker system prune -f after a build gets rid of most of it.

  • gamer@lemm.ee
    link
    fedilink
    English
    arrow-up
    2
    ·
    1 year ago

    I use podman, and the standalone tool “buildah” can build images from dockerfiles, and the tool “skopeo” can upload it to an image repository.

  • skookumasfrig@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    3
    arrow-down
    1
    ·
    1 year ago

    I use portainer, and when I deploy an image, I write a short bash script for it.

    • stop the image if running
    • pull the image
    • run the image

    This lets me easily do updates. I have a script for each image I run, it’s less than a dozen. They’re all from public repositories.

  • Irisos@lemmy.umainfo.live
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    For development, I have a single image per project tagged “dev” running locally in WSL that I overwrite over and over again.

    For real builds, I use pipelines on my Azure DevOps server to build the image on an agent using a remote buildkit container and push it in my internal repository. All 3 components hosted in the same kubernetes cluster.