summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2009-10-26Added new cronjob script to clean up unneeded sourceballsEric Bélanger
This script is intended to be a weekly cron-job. It supplements the current sourceballs cleanup in make-sourceball that only removes the old sourceballs. This script removes the sourceballs of packages that were either removed completely from the repo or moved to a splitted package. It also checks the license of the packages which have a sourceball to see, in case of a license change, if the hosting of the sources is still necessary. Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-10-26Added source-cleanup directory supportEric Bélanger
Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-10-26Moved chk_license to db-functions fileEric Bélanger
Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-10-26Moved ALLOWED_LICENSES declaration to config fileEric Bélanger
Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-25sourceballs: skip based on pkgbase failuresAaron Griffin
If one portion of a split package fails, assume that all packages from the same $pkgbase are going to fail as well and skip them for this run. Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-24Fixed test for existence of split package sourcesAaron Griffin
This patch also removes the unused CARCH variable. Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> [Aaron: Broke srcpkgbase logic into srcpkgname/srcpkgbase to make it more readable] Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-23make-sourceball: Re-add file parsing of name/verAaron Griffin
getpkgname / getpkgver were replaced with versions that scanned the .PKGINFO file. These don't work for source packages, so add the functionality back in for this case Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-23make-sourceballs: clean up outputAaron Griffin
Only output "Creating sourceball" text when we're actually creating it Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-23Fixed split packages support in sourceballs scriptEric Bélanger
Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-22Renamed community-testing2* scriptsAaron Griffin
We know the repo. Lets make the names nicer Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-21Add a safety check for existence in pkg loopAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-21Modify sourceball remove_old functionAaron Griffin
The revampled getpkgname/getpkgver functions need the full path to the file now, not just the filename Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-21Set/restore umask in the sourceballs cron jobAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-21Temporarily disable community sourceball generationAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-21Merge branch 'master' of file:///srv/projects/git/dbscriptsAaron Griffin
2009-09-21check_packages : fix a bug when filling provisionsXavier Chantry
When we had a duplicate package, we would replace the old ref by the new ref. But the provisions dict kept both the old and new ref. This was not good at all. Now, we just keep the old ref, and we only fill provisions after all packages have been parsed. This should be much more sane. Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18integrity-check: Rename $3 -> $2Aaron Griffin
OMFG such a simple script and I keep missing crap Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18integrity-check: Forgot to decrement the arg countAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18integrity-check: Loop over archesAaron Griffin
THis simplifies the command line and we do both anyway Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18check_archlinux: absroot -> absrootsAaron Griffin
Allow us to use the --abs-root flag. He he Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18Bump check_archlinux module for libalpm.so.4Aaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18parse_pkgbuilds.sh : fix pkgbase handlingXavier Chantry
add the default value for pkgbase also rework slightly how variables are handled (better distinction between splitpkg variables and the rest) Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18improve the way parse_pkgbuilds.sh is calledXavier Chantry
1) check the return value. before a failed call to parse_pkgbuilds.sh was completely silent.. not good :) 2) call realpath on check_packages.py before determining the directory name, to figure out where parse_pkgbuilds.sh is. This allows to symlink check_packages.py and use the symlink without moving parse_pkgbuilds.sh . for example : /foo/bar/ contains check_packages.py and parse_pkgbuilds.sh ln -s /foo/bar/check_packages.py /bin/check_package dirname(/bin/check_package) returns /bin/ so not good dirname(realpath(/bin/check_package)) returns /foo/bar/ so good Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18parse_pkgbuilds : simple performance tweakXavier Chantry
this simple tweak gives a nice perf boost : from 10s to 7s to parse extra repo. indeed calling basename caused a fork to happen for the thousand of files being considered Now the major bottleneck is parsing split pkgbuilds, but I am afraid there is no magical solution for that :( Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18improve compute_dep algorithmXavier Chantry
The compute_dep function I wrote for the more informative hierarchy output was very inefficient. It's much better now (10s -> 0.5s) on my box, and I get exactly the same results :) Now the big majority of the time is again spent on parsing pkgbuilds. Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18add the repo/ info to most results, and sort themXavier Chantry
Add repo information to most results by using the repo/pkgname syntax (instead of only pkgname) Sort all results list (with the point above, this sorts the results by repo :)) Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18Add db comparison to integrity checkHenning Garus
Compare the abs tree with the repo dbs to check if we have a PKGBUILD for each package in the dbs and vice versa. Signed-off-by: Henning Garus <henning.garus@gmail.com> Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18check_packages.py: Allow multiple abs-treesHenning Garus
By parsing multiple abs trees we can add any when parsing the other trees, checking any standalone doesn't make much sense. Signed-off-by: Henning Garus <henning.garus@gmail.com> Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18Add "testing to repo" for any pkgs in communityDaniel J Griffiths
Whoops, missed this in the last commit Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18Add "testing to repo" scripts for communityDaniel J Griffiths
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18Add db-community-testingDaniel J Griffiths
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18ftpdir-cleanup: Additional getpkgname cleanupAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18ftpdir-cleanup: get rid of local getpkgnameAaron Griffin
This is in the db-functions file, and does a better job. In order to do this, we had to change some path related code Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18Collapse duplicate loops for staging removalAaron Griffin
Add 'any' to the items looped over in the ${ARCHES[@]} loop Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18Remove pkg from $stagedir if already in FTP repoFrancois Charette
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18added testing2...-any scriptsFrancois Charette
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18Remove '$arch' from file loopAaron Griffin
This allows us to still remove older, non architecture prefixed packages Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18Minor: remove unused variableAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-13Maybe I should make the script really adjust permissionsDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2009-09-13Ensure you don't update DBs on the wrong serverDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2009-09-13Add new get_repos_for_host() functionDan McGee
And use it. This allows us to have server-specific behavior in our scripts without further patching, and it also allows us to simplify some of our scripts a fair amount. Signed-off-by: Dan McGee <dan@archlinux.org>
2009-09-13Be more careful with config file inclusionDan McGee
We can't really do the basedir magic from db-functions as it is just being sourced and is not the currently executing script. Although a bit repetitive, it is a lot safer to just include the config file everywhere. Noticed this when trying to run the latest available scripts on sigurd. Signed-off-by: Dan McGee <dan@archlinux.org>
2009-09-08Added sourceballs.force entriesAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-01sourceballs: explicitly add the 'any' archAaron Griffin
Loop over all arches AND the 'any' arch. Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-28add deplist to hierarchy problemsXavier Chantry
This should help a lot figuring out whether a given hierarchy problem is fixable (if it doesn't require moving too many deps). example output core/crda depends on extra/python-m2crypto (27 extra (make)deps to pull) core/iputils depends on extra/opensp (29 extra (make)deps to pull) core/iputils depends on extra/libxslt (25 extra (make)deps to pull) core/iputils depends on extra/docbook-xsl (27 extra (make)deps to pull) core/udev depends on extra/gperf (0 extra (make)deps to pull) core/udev depends on extra/libxslt (25 extra (make)deps to pull) core/e2fsprogs depends on extra/bc (0 extra (make)deps to pull) core/sqlite3 depends on extra/tcl (0 extra (make)deps to pull) core/ca-certificates depends on extra/ruby (25 extra (make)deps to pull) the actual deps are only displayed when there are less than 10. Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-28check_packages : add support for split packages.Xavier Chantry
I just found a way to support split packages, by using $(type package_${pkg}), parsing that output and running eval on the relevant lines. This is a bit ugly, and while it works fine on my machine and my current abs tree, I cannot guarantee this code is bug free :) Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-25Quiet sourceball output when license is skippedAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-25Add SRCEXT to configAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-18Fix arch parameter handling in db-removeEric Bélanger
db-remove use the arch variable to handle the arch parameter passed to the script. As the arch variable is already used in PKGBUILD, this variable conflict cause unwanted behaviour. Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-18Replace pkgname with pkgbase, for split packagesAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
generated by cgit v1.2.3-54-g00ecf (git 2.45.2) at 2024-12-26 17:19:17 +0000