summaryrefslogtreecommitdiff
path: root/misc-scripts
AgeCommit message (Collapse)Author
2010-08-18Rewrite ftpdir-cleanupPierre Schmitz
* runtime reduced to < 1 second * uses file lists and the comm command * searches for missing packages * removes empty legacy directories like extra/os/any
2010-08-18Fix cleanup of old packagesPierre Schmitz
* This should fix the cleanup of packages that were not within the pacakge pool before being updated. * a test case for this was added
2010-08-13Use common functions to print messages, warnings and errorsPierre Schmitz
These functions are copied from makepkg
2010-08-08Source PKGBUILD in subshellsPierre Schmitz
This patch sources a PKGBUILD in a subshells instead of directly. This way we don't polute our scope or overwrite our vars which might lead to unexpected behavior.
2010-08-08Move common function to db-functionsPierre Schmitz
db-functions now sets an individual $WORKDIR and implements trap functinos that remove locks on exit or error. There are new functions to lock and unlock the running script. misc-scripts/ftpdir-cleanup was renamed to ftpdir-cleanup-repo as the cron-job had the same name. Script names have to be unique when using db-functions.
2010-08-08use common workdirPierre Schmitz
2010-08-08Remove BUILDSCRIPT variablePierre Schmitz
There is no need to have a variable for things like PKGBUILD that are very unlikely to ever change.
2010-08-08fix cleaning of any packages and ignore empty reposPierre Schmitz
2010-06-28sourceballs: Added community and community-testing supportEric Bélanger
Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> Signed-off-by: Pierre Schmitz <pierre@archlinux.de>
2010-05-02ftpdir-cleanup: Add clean_pkgs functionAaron Griffin
This should remove files if they are symlinks (pooled packages) and move them to the cleanup dir if not
2010-04-28Change ftpdir-cleanup scripts for package poolingAaron Griffin
* The per repo script now simply removes files as they should all be symlinks at this time * The cron job script will do the extra job of checking the global pool. If there are no more symlinks, move the pooled package Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2010-04-28Remove FTP_OS_SUFFIX variableAaron Griffin
This isn't needed and if "os" ever changes, we have bigger changes. Won't save us any time and it's longer to type.
2010-04-11Do not overwrite TMPDIR defined in configPierre Schmitz
2010-04-11Fail if lock couldn't be obtained; Unlock the repos if ftpdir-cleanup failsPierre Schmitz
2010-03-13sourceballs: Make cleanup more efficientEric Bélanger
Moved all cleanup related code in sourceballs-cleanup script and moved, now common, functions in db-functions. The cleanup script is now ran after all the new sourceballs have been fetched. Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com>
2010-03-03Make repo locking an atomic process and added timeout argumentEric Bélanger
The repo locking function now use a lock directory instead of a lock file. This makes the lock checking and creation an atomic process. The repo_lock function will now try to obtain a lock every $LOCK_DELAY seconds until it is successful. An optional third argument can be use to give a timeout in seconds; this is intended for scripts that runs unattended. Repo locking is now used in the ftpdir-cleanup script. This should fix the problem of the ftpdir-cleanup script removing the new package instead of the old one (FS#17058). Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com>
2010-02-23Hide 'file not found' messagePierre Schmitz
2010-02-21remove unneeded and now broken checkPierre Schmitz
2010-02-21add dry run option to ftpdir-cleanupPierre Schmitz
Signed-off-by: Pierre Schmitz <pierre@archlinux.de>
2009-10-26Added source-cleanup directory supportEric Bélanger
Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-10-26Moved chk_license to db-functions fileEric Bélanger
Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-10-26Moved ALLOWED_LICENSES declaration to config fileEric Bélanger
Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-23make-sourceball: Re-add file parsing of name/verAaron Griffin
getpkgname / getpkgver were replaced with versions that scanned the .PKGINFO file. These don't work for source packages, so add the functionality back in for this case Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-23make-sourceballs: clean up outputAaron Griffin
Only output "Creating sourceball" text when we're actually creating it Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-23Fixed split packages support in sourceballs scriptEric Bélanger
Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-21Modify sourceball remove_old functionAaron Griffin
The revampled getpkgname/getpkgver functions need the full path to the file now, not just the filename Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18ftpdir-cleanup: Additional getpkgname cleanupAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18ftpdir-cleanup: get rid of local getpkgnameAaron Griffin
This is in the db-functions file, and does a better job. In order to do this, we had to change some path related code Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18Remove '$arch' from file loopAaron Griffin
This allows us to still remove older, non architecture prefixed packages Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18Minor: remove unused variableAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-13Be more careful with config file inclusionDan McGee
We can't really do the basedir magic from db-functions as it is just being sourced and is not the currently executing script. Although a bit repetitive, it is a lot safer to just include the config file everywhere. Noticed this when trying to run the latest available scripts on sigurd. Signed-off-by: Dan McGee <dan@archlinux.org>
2009-08-25Quiet sourceball output when license is skippedAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-18Use db-functions file everywhereAaron Griffin
This source the config file and gets us functions such as getpkgname which were duplicated elsewhere Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-18More removal of DB_COMPRESSION from cron jobsAaron Griffin
Remove dependance on makepkg.conf Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-18More makepkg.conf removal - prefer toplevel configAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-18Remove find-dupes script (unused)Aaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-18Variable rename fix: SVN_PATH -> SVNREPOEric Bélanger
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-17Replace a string compare with a -f checkAaron Griffin
No real reason, this is just easier to understand, and checks like this should be the norm. If file does not exist, continue Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-16Add DB_COMPRESSION='gz', as this has been removed from makepkg.confThomas Bächler
2009-08-16Make ftpdir-cleanup NOT delete all packages if databas extraction failsThomas Bächler
2009-08-16Avoid confusing messages and potential problems when no packages are presentThomas Bächler
If no packages are present in the repository, a message like this will be generated, and the corresponding mv command will be issued. Prevent this by checking if *$arch$PKGEXT equals "*$arch$PKGEXT": Scan complete for core (i686) at /srv/ftp/core/os/i686 The following files are in the repo but not the db They will be moved to '/srv/package-cleanup' *i686.pkg.tar.gz
2009-07-22ftpdir-cleanup: Loop over arches for 'any' linksAaron Griffin
Remove the hardcoded i686/x86_64 and loop over the ARCHES array in the config file, checking for valid symlinks. If none are found, remove the 'any' package Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-22ftpdir-cleanup: Minimize outputAaron Griffin
Clean up some output so when we do nothing, we get no output This is preferred as the mailer will simply not send a mail in this case. Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-21Very minor additionsFrancois Charette
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-21Bugfix: make TMPDIR within the for loopFrancois Charette
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-21Refactor ftpdir-cleanup to handle all archesFrancois Charette
This may look like a rather large patch, but the changes are mostly a reshuffling of the code to loop over all arches first, and then handle the arch-indep packages. The cronjob has been changed accordingly. Added new category DELETESYMLINKS, which are deleted instead of being moved to package-cleanup. I have also fixed the arch-specific issue with the ftppath, using parameters in config instead. Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-20any support: use relative symlinksAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-20ftpdir-cleanup: Fix ARCHINDEP parsingAaron Griffin
Failed hard on empty 'any' directories Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-20ftpdir-cleanup: Fix the symlink restore loopAaron Griffin
Previous logic was stupid... let's just check the missing files. If it's missing and exists in the any dir, then common sense says we deleted a symlink somewhere... Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-20ftpdir-cleanup: Fixes for 'any' supportAaron Griffin
* Break out ftppath, base it on ftbpath_base * Only check ARCHINDEPFILES if the any dir exists * Attempt to restore symlinks before moving 'any' files out of the way Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>