Last active
March 3, 2025 12:06
-
-
Save JonasGroeger/1b5155e461036b557d0fb4b3307e1e75 to your computer and use it in GitHub Desktop.
Gitlab: Clone / Pull all projects in a group
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/usr/bin/env bash | |
# Documentation | |
# https://docs.gitlab.com/ce/api/projects.html#list-projects | |
NAMESPACE="YOUR_NAMESPACE" | |
BASE_PATH="https://gitlab.example.com/" | |
PROJECT_SEARCH_PARAM="" | |
PROJECT_SELECTION="select(.namespace.name == \"$NAMESPACE\")" | |
PROJECT_PROJECTION="{ "path": .path, "git": .ssh_url_to_repo }" | |
if [ -z "$GITLAB_PRIVATE_TOKEN" ]; then | |
echo "Please set the environment variable GITLAB_PRIVATE_TOKEN" | |
echo "See ${BASE_PATH}profile/account" | |
exit 1 | |
fi | |
FILENAME="repos.json" | |
trap "{ rm -f $FILENAME; }" EXIT | |
curl -s "${BASE_PATH}api/v3/projects?private_token=$GITLAB_PRIVATE_TOKEN&search=$PROJECT_SEARCH_PARAM&per_page=999" \ | |
| jq --raw-output --compact-output ".[] | $PROJECT_SELECTION | $PROJECT_PROJECTION" > "$FILENAME" | |
while read repo; do | |
THEPATH=$(echo "$repo" | jq -r ".path") | |
GIT=$(echo "$repo" | jq -r ".git") | |
if [ ! -d "$THEPATH" ]; then | |
echo "Cloning $THEPATH ( $GIT )" | |
git clone "$GIT" --quiet & | |
else | |
echo "Pulling $THEPATH" | |
(cd "$THEPATH" && git pull --quiet) & | |
fi | |
done < "$FILENAME" | |
wait |
I wanted to clone also subgroups while keeping the tree structure. Since none of the solutions worked flawless, I wrote my own simple script => https://github.com/adroste/gitlab-clone-group
这是来自QQ邮箱的假期自动回复邮件。您好,我最近正在休假中,无法亲自回复您的邮件。我将在假期结束后,尽快给您回复。
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Hey @JonasGroeger , when I tried using your script, got an error of "parse error: Invalid numeric literal at line 1, column 16". Not sure exactly what Iam giving wrong, here is the snippet of my code -
#!/usr/bin/env bash
Documentation
https://docs.gitlab.com/ce/api/projects.html#list-projects
NAMESPACE="fsgbu-pbsm/fsgbu-ofspacs/dimension-management"
GITLAB_PRIVATE_TOKEN="xxxx7fcxx32xxxxw4xx"
BASE_PATH="https://cloudlab.us.oracle.com/"
PROJECT_SEARCH_PARAM=""
PROJECT_SELECTION="select(.namespace.name == "$NAMESPACE")"
PROJECT_PROJECTION="{ "path": .path, "git": .ssh_url_to_repo }"
if [ -z "$GITLAB_PRIVATE_TOKEN" ]; then
echo "Please set the environment variable GITLAB_PRIVATE_TOKEN"
echo "See ${BASE_PATH}profile/account"
exit 1
fi
FILENAME="repos.json"
............
Note-> I need to pull all subgroups under group dimension-management.