summaryrefslogtreecommitdiff
path: root/cron-jobs/sourceballs
AgeCommit message (Collapse)Author
2011-02-20Changes to sourceball everythingNicolás Reynolds
2011-02-18First stab at sourceballing everythingNicolás Reynolds
2011-01-30Make sure to only remove package files from the cleanup dirsPierre Schmitz
2010-12-18Remove old files from the cleanup dirsPierre Schmitz
2010-12-18Touch old packages after moving them to the cleanup dirsPierre Schmitz
This updates the mtime of those files and will help us to remove them later.
2010-11-25sourceballs: be nicePierre Schmitz
2010-11-25Added seperate dryrun options for the packages and sources cleanup scriptsEric Bélanger
Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> Signed-off-by: Pierre Schmitz <pierre@archlinux.de>
2010-11-24sourceballs: fix working directoryPierre Schmitz
2010-11-23sourceballs: Move to our workdir first to fix warning with sudo usagePierre Schmitz
2010-11-23sourceballs: avoid failing twicePierre Schmitz
2010-11-23sourceballs: fix outputPierre Schmitz
2010-11-23sourceballs: be less verbosePierre Schmitz
2010-11-23Rewrite sourceballs to increase performance and reliabilityPierre Schmitz
* Decrease file stats as much as possible * Create a list of all packages and meta data only once * Create a list of available source packages only once * Create a list of expected packages only once * Combine all three scripts into one to share data and code * Use as much information from the db files as possible and avoid using svn * Avoid attempting to create the same source package twice Logic works as follows: 1) create a list of all packages 2) Check for each package if we need a src package and create one 3) During this process create a list of all src packages that should be there 4) Diff both lists for the cleanup
2010-11-21sourceballs: Of course sort does only operate on linesPierre Schmitz
2010-11-21sourceballs: Don't write any logPierre Schmitz
This is consistent with the other dbscripts. The output will be send to the mailinglist.
2010-11-20sourceballs: Lock the repo while reading the db filePierre Schmitz
2010-11-20Simplify sourceballs creationPierre Schmitz
* Read package lists directly from DB file * Make SVNREPO configurable
2010-11-20Fix sourceballs cron jobPierre Schmitz
* add unit test for sourceballs and cleanup * introduce SRCPOOL and LOGDIR variables in config
2010-09-13Fix typosPierre Schmitz
2010-09-01Simplify repo configurationPierre Schmitz
* Repositories can now be defined in the config file for each host * added community-staging, gnome-unstable and kde-unstable * Exception is the adjust-permission cron-job; but we might want to use acls in future anyway Signed-off-by: Pierre Schmitz <pierre@archlinux.de>
2010-08-22add makepkg.conf for [multilib]Pierre Schmitz
2010-08-17Add [staging] repositoryPierre Schmitz
2010-08-13Use common functions to print messages, warnings and errorsPierre Schmitz
These functions are copied from makepkg
2010-08-08Use db-functions in create-filelists and sourceballsPierre Schmitz
2010-06-28sourceballs: Added community and community-testing supportEric Bélanger
Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> Signed-off-by: Pierre Schmitz <pierre@archlinux.de>
2010-03-13sourceballs: Make cleanup more efficientEric Bélanger
Moved all cleanup related code in sourceballs-cleanup script and moved, now common, functions in db-functions. The cleanup script is now ran after all the new sourceballs have been fetched. Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com>
2009-09-25sourceballs: skip based on pkgbase failuresAaron Griffin
If one portion of a split package fails, assume that all packages from the same $pkgbase are going to fail as well and skip them for this run. Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-24Fixed test for existence of split package sourcesAaron Griffin
This patch also removes the unused CARCH variable. Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> [Aaron: Broke srcpkgbase logic into srcpkgname/srcpkgbase to make it more readable] Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-21Add a safety check for existence in pkg loopAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-21Set/restore umask in the sourceballs cron jobAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-21Temporarily disable community sourceball generationAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-13Be more careful with config file inclusionDan McGee
We can't really do the basedir magic from db-functions as it is just being sourced and is not the currently executing script. Although a bit repetitive, it is a lot safer to just include the config file everywhere. Noticed this when trying to run the latest available scripts on sigurd. Signed-off-by: Dan McGee <dan@archlinux.org>
2009-09-01sourceballs: explicitly add the 'any' archAaron Griffin
Loop over all arches AND the 'any' arch. Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-18Replace pkgname with pkgbase, for split packagesAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-18Use db-functions file everywhereAaron Griffin
This source the config file and gets us functions such as getpkgname which were duplicated elsewhere Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-18More makepkg.conf removal - prefer toplevel configAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-22Use the top level config file for cron-jobsAaron Griffin
Source our config file, and use ARCHES from it Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-17sourceballs: skip nonexistant FTP pathsAaron Griffin
This is useful when running on separate machines that don't have all repos Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-17Add community and 'any' arch to sourceballsAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-23Ensure grep matches only full pkgnamesAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-16sourceballs: copy previous errors.txt output fileAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-13Keep the last failed.txt too for comparisonAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-13Fix pkgname parsing for files without ARCHAaron Griffin
Split the srcpkg parsing into two separate steps, one to swap the extensions, and another to remove the architecture Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-13Allow skipping of sourceball license checkAaron Griffin
Also add a whitelist of files to skip (empty right now) Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-11Output stderr to an error file for each runAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-09Write out failed packages to a txt fileAaron Griffin
Located at /srv/ftp/sources/failed.txt Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-04Remove 'skipping' output. Not neededAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-11-21Move cron-jobs to /srv from /homeAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-09-02Remove 'unstable' from sourceball creationAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-08-31Add sourceball cron job at the proper path (whoops)Aaron Griffin
Also remove readline from the skip-list Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>