summaryrefslogtreecommitdiff
path: root/cron-jobs/sourceballs
AgeCommit message (Collapse)Author
2016-04-17Use += instead of jumping through hoops.Luke Shumaker
The += operator was introduced in Bash 3.1, and was already used in some places in dbscripts, but not everywhere. For normal strings, this isn't a big deal, but appending to an array without using += is nasty.
2016-04-16Use printf-formatters instead of string interpolation on msg, error, etc.Luke Shumaker
2016-04-16Fix quoting around variables, especially arrays.Luke Shumaker
Other than pure quoting, this involved: - swapping */@ for array access in a few places - fiddling with printf in a pipeline - replacing `$(echo ${array[@]})` with `${array[*]}` - replacing `echo $(...)` with `...` When searching for these things, I used the command: grep -Prn --exclude-dir=.git '(?<!["=]|\[\[ |\[\[ -[zn] )\$(?!{?#|\(|\? )' and ignored a bunch of false positives.
2014-11-01cron-jobs: Fix issues with empty repositoriesPierre Schmitz
2013-11-02sourceballs: fix ACL issues on nymeriaJan Alexander Steffens (heftig)
ACLs from the WORKDIR were used, leading to problems as these weren't world-readable. Fix follows ftpdir-cleanup. Signed-off-by: Jan Alexander Steffens (heftig) <jan.steffens@gmail.com> Signed-off-by: Pierre Schmitz <pierre@archlinux.de>
2012-11-25Fix sourceballs permissionsPierre Schmitz
2012-10-27Add the possibility to run all svn commands with a different userPierre Schmitz
* A SVNUSER can be configured in the config file * This user needs to be able to call svn without a password
2012-06-10Use our own copy of makepkg.conf instead of depending on the host onePierre Schmitz
2012-04-29Source the config before the functions as the latter references the formerPierre Schmitz
2012-03-07sourceballs: If ALLOWED_LICENSES is empty create source packages for every ↵Pierre Schmitz
package
2012-02-19Do not check source gpg signaturesPierre Schmitz
2012-02-19Sourceballs: Output details if fetching the sources failedPierre Schmitz
2011-01-30Make sure to only remove package files from the cleanup dirsPierre Schmitz
2010-12-18Remove old files from the cleanup dirsPierre Schmitz
2010-12-18Touch old packages after moving them to the cleanup dirsPierre Schmitz
This updates the mtime of those files and will help us to remove them later.
2010-11-25sourceballs: be nicePierre Schmitz
2010-11-25Added seperate dryrun options for the packages and sources cleanup scriptsEric Bélanger
Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> Signed-off-by: Pierre Schmitz <pierre@archlinux.de>
2010-11-24sourceballs: fix working directoryPierre Schmitz
2010-11-23sourceballs: Move to our workdir first to fix warning with sudo usagePierre Schmitz
2010-11-23sourceballs: avoid failing twicePierre Schmitz
2010-11-23sourceballs: fix outputPierre Schmitz
2010-11-23sourceballs: be less verbosePierre Schmitz
2010-11-23Rewrite sourceballs to increase performance and reliabilityPierre Schmitz
* Decrease file stats as much as possible * Create a list of all packages and meta data only once * Create a list of available source packages only once * Create a list of expected packages only once * Combine all three scripts into one to share data and code * Use as much information from the db files as possible and avoid using svn * Avoid attempting to create the same source package twice Logic works as follows: 1) create a list of all packages 2) Check for each package if we need a src package and create one 3) During this process create a list of all src packages that should be there 4) Diff both lists for the cleanup
2010-11-21sourceballs: Of course sort does only operate on linesPierre Schmitz
2010-11-21sourceballs: Don't write any logPierre Schmitz
This is consistent with the other dbscripts. The output will be send to the mailinglist.
2010-11-20sourceballs: Lock the repo while reading the db filePierre Schmitz
2010-11-20Simplify sourceballs creationPierre Schmitz
* Read package lists directly from DB file * Make SVNREPO configurable
2010-11-20Fix sourceballs cron jobPierre Schmitz
* add unit test for sourceballs and cleanup * introduce SRCPOOL and LOGDIR variables in config
2010-09-13Fix typosPierre Schmitz
2010-09-01Simplify repo configurationPierre Schmitz
* Repositories can now be defined in the config file for each host * added community-staging, gnome-unstable and kde-unstable * Exception is the adjust-permission cron-job; but we might want to use acls in future anyway Signed-off-by: Pierre Schmitz <pierre@archlinux.de>
2010-08-22add makepkg.conf for [multilib]Pierre Schmitz
2010-08-17Add [staging] repositoryPierre Schmitz
2010-08-13Use common functions to print messages, warnings and errorsPierre Schmitz
These functions are copied from makepkg
2010-08-08Use db-functions in create-filelists and sourceballsPierre Schmitz
2010-06-28sourceballs: Added community and community-testing supportEric Bélanger
Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> Signed-off-by: Pierre Schmitz <pierre@archlinux.de>
2010-03-13sourceballs: Make cleanup more efficientEric Bélanger
Moved all cleanup related code in sourceballs-cleanup script and moved, now common, functions in db-functions. The cleanup script is now ran after all the new sourceballs have been fetched. Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com>
2009-09-25sourceballs: skip based on pkgbase failuresAaron Griffin
If one portion of a split package fails, assume that all packages from the same $pkgbase are going to fail as well and skip them for this run. Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-24Fixed test for existence of split package sourcesAaron Griffin
This patch also removes the unused CARCH variable. Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> [Aaron: Broke srcpkgbase logic into srcpkgname/srcpkgbase to make it more readable] Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-21Add a safety check for existence in pkg loopAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-21Set/restore umask in the sourceballs cron jobAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-21Temporarily disable community sourceball generationAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-13Be more careful with config file inclusionDan McGee
We can't really do the basedir magic from db-functions as it is just being sourced and is not the currently executing script. Although a bit repetitive, it is a lot safer to just include the config file everywhere. Noticed this when trying to run the latest available scripts on sigurd. Signed-off-by: Dan McGee <dan@archlinux.org>
2009-09-01sourceballs: explicitly add the 'any' archAaron Griffin
Loop over all arches AND the 'any' arch. Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-18Replace pkgname with pkgbase, for split packagesAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-18Use db-functions file everywhereAaron Griffin
This source the config file and gets us functions such as getpkgname which were duplicated elsewhere Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-18More makepkg.conf removal - prefer toplevel configAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-22Use the top level config file for cron-jobsAaron Griffin
Source our config file, and use ARCHES from it Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-17sourceballs: skip nonexistant FTP pathsAaron Griffin
This is useful when running on separate machines that don't have all repos Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-17Add community and 'any' arch to sourceballsAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-23Ensure grep matches only full pkgnamesAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>