summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2010-06-20add initial .gitignore filePierre Schmitz
2010-05-03Add PKGPOOL_DIR config variableAaron Griffin
This is a relative var, descendent from FTP_BASE. We do this because we also need a relative path to the package pool dir
2010-05-02ftpdir-cleanup: Add clean_pkgs functionAaron Griffin
This should remove files if they are symlinks (pooled packages) and move them to the cleanup dir if not
2010-04-28ftpdir-cleanup: use 'find' for symlink detectionAaron Griffin
This gets rid of a bash loop for link detection
2010-04-28ftpdir-cleanup: Fix cleanup of package poolAaron Griffin
2010-04-28Change ftpdir-cleanup scripts for package poolingAaron Griffin
* The per repo script now simply removes files as they should all be symlinks at this time * The cron job script will do the extra job of checking the global pool. If there are no more symlinks, move the pooled package Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2010-04-28Remove FTP_OS_SUFFIX variableAaron Griffin
This isn't needed and if "os" ever changes, we have bigger changes. Won't save us any time and it's longer to type.
2010-04-28db-update: Use a master package pool and symlinksAaron Griffin
This should save lots of transfer time with the mirrors :) Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2010-04-11Do not overwrite TMPDIR defined in configPierre Schmitz
2010-04-11Fail if lock couldn't be obtained; Unlock the repos if ftpdir-cleanup failsPierre Schmitz
2010-03-31fix permissions of incoming packagesAndrea Scarpino
Signed-off-by: Pierre Schmitz <pierre@archlinux.de>
2010-03-31don't publish *.old filesPierre Schmitz
2010-03-13moving sourceballs-cleanupEric Bélanger
2010-03-13sourceballs: Make cleanup more efficientEric Bélanger
Moved all cleanup related code in sourceballs-cleanup script and moved, now common, functions in db-functions. The cleanup script is now ran after all the new sourceballs have been fetched. Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com>
2010-03-03Make repo locking an atomic process and added timeout argumentEric Bélanger
The repo locking function now use a lock directory instead of a lock file. This makes the lock checking and creation an atomic process. The repo_lock function will now try to obtain a lock every $LOCK_DELAY seconds until it is successful. An optional third argument can be use to give a timeout in seconds; this is intended for scripts that runs unattended. Repo locking is now used in the ftpdir-cleanup script. This should fix the problem of the ftpdir-cleanup script removing the new package instead of the old one (FS#17058). Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com>
2010-03-01Merge branch 'filelists'Dan McGee
2010-02-27create-filelists: include desc/depends entriesDan McGee
Make the files DB include everything the original packages DB includes instead of just being 'files' entries. This will allow tools to do more with these generated files and they can be used as a drop-in replacement for a regular package database. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-02-27create-filelists: rework the package loop completelyDan McGee
Instead of wasting time extracting .PKGINFO twice from every single package in the repos, use the package DB to eliminate most of the heavy lifting. This way we only need to worry about looking at the packages that actually have changed since the last time we built the package database. This should give a noticeable performance increase to this job in addition to reducing IO load and unnecessary reading of every package file. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-02-27create-filelists: s/REPO_DB_FILE/FILES_DB_FILE/gDan McGee
This will set up changes soon to come where we actually use the real repos DB file so I don't want variable name confusion. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-02-27create-filelists: general cleanupsDan McGee
* Specify lock name once * Use new script name everywhere * Clean up tabs/spaces and add a modeline. This isn't necessarily the one we wanted to standardize on, but I picked the one the entire file is written to at the moment. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-02-23Hide 'file not found' messagePierre Schmitz
2010-02-21remove unneeded and now broken checkPierre Schmitz
2010-02-21Accept any *.pkg.tar.* package file namePierre Schmitz
With this patch packages with different compressions are accepted. It is ensured that one cannot have the same package with different compression extensions. The new functions getpkgfile{,s} are used to sanitize globed filenames. Signed-off-by: Pierre Schmitz <pierre@archlinux.de>
2010-02-21add dry run option to ftpdir-cleanupPierre Schmitz
Signed-off-by: Pierre Schmitz <pierre@archlinux.de>
2010-02-21remove unused scriptPierre Schmitz
Signed-off-by: Pierre Schmitz <pierre@archlinux.de>
2009-10-31create-filelists: Add pkgver-pkgrel to directory nameThomas Bächler
In the past, pkgname-pkgver-pkgrel was extracted from the filename and sadly named "pkgname". Restore this behaviour
2009-10-31create-filelists: fix another typoThomas Bächler
2009-10-31create-filelists: add community-testingThomas Bächler
2009-10-31Fix a typo introduced in 38c7241ad2528b29a65a0b81b980e76d1046e94eThomas Bächler
2009-10-29create-filelists: Call getpkgname for realAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-10-29Cleanup create-filelistsAaron Griffin
* Quote absolutely everything * Move directory slashes around, for readability * Move a cd to the top of the loop Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-10-29Rename createFileLists to be more like the othersAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-10-29Echo pkginfo parsing errors to stderrAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-10-26Added new cronjob script to clean up unneeded sourceballsEric Bélanger
This script is intended to be a weekly cron-job. It supplements the current sourceballs cleanup in make-sourceball that only removes the old sourceballs. This script removes the sourceballs of packages that were either removed completely from the repo or moved to a splitted package. It also checks the license of the packages which have a sourceball to see, in case of a license change, if the hosting of the sources is still necessary. Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-10-26Added source-cleanup directory supportEric Bélanger
Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-10-26Moved chk_license to db-functions fileEric Bélanger
Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-10-26Moved ALLOWED_LICENSES declaration to config fileEric Bélanger
Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-25sourceballs: skip based on pkgbase failuresAaron Griffin
If one portion of a split package fails, assume that all packages from the same $pkgbase are going to fail as well and skip them for this run. Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-24Fixed test for existence of split package sourcesAaron Griffin
This patch also removes the unused CARCH variable. Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> [Aaron: Broke srcpkgbase logic into srcpkgname/srcpkgbase to make it more readable] Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-23make-sourceball: Re-add file parsing of name/verAaron Griffin
getpkgname / getpkgver were replaced with versions that scanned the .PKGINFO file. These don't work for source packages, so add the functionality back in for this case Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-23make-sourceballs: clean up outputAaron Griffin
Only output "Creating sourceball" text when we're actually creating it Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-23Fixed split packages support in sourceballs scriptEric Bélanger
Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-22Renamed community-testing2* scriptsAaron Griffin
We know the repo. Lets make the names nicer Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-21Add a safety check for existence in pkg loopAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-21Modify sourceball remove_old functionAaron Griffin
The revampled getpkgname/getpkgver functions need the full path to the file now, not just the filename Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-21Set/restore umask in the sourceballs cron jobAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-21Temporarily disable community sourceball generationAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-21Merge branch 'master' of file:///srv/projects/git/dbscriptsAaron Griffin
2009-09-21check_packages : fix a bug when filling provisionsXavier Chantry
When we had a duplicate package, we would replace the old ref by the new ref. But the provisions dict kept both the old and new ref. This was not good at all. Now, we just keep the old ref, and we only fill provisions after all packages have been parsed. This should be much more sane. Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18integrity-check: Rename $3 -> $2Aaron Griffin
OMFG such a simple script and I keep missing crap Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
generated by cgit v1.2.3-54-g00ecf (git 2.45.2) at 2024-11-05 07:56:24 +0000