summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2009-09-18parse_pkgbuilds : simple performance tweakXavier Chantry
this simple tweak gives a nice perf boost : from 10s to 7s to parse extra repo. indeed calling basename caused a fork to happen for the thousand of files being considered Now the major bottleneck is parsing split pkgbuilds, but I am afraid there is no magical solution for that :( Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18improve compute_dep algorithmXavier Chantry
The compute_dep function I wrote for the more informative hierarchy output was very inefficient. It's much better now (10s -> 0.5s) on my box, and I get exactly the same results :) Now the big majority of the time is again spent on parsing pkgbuilds. Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18add the repo/ info to most results, and sort themXavier Chantry
Add repo information to most results by using the repo/pkgname syntax (instead of only pkgname) Sort all results list (with the point above, this sorts the results by repo :)) Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18Add db comparison to integrity checkHenning Garus
Compare the abs tree with the repo dbs to check if we have a PKGBUILD for each package in the dbs and vice versa. Signed-off-by: Henning Garus <henning.garus@gmail.com> Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18check_packages.py: Allow multiple abs-treesHenning Garus
By parsing multiple abs trees we can add any when parsing the other trees, checking any standalone doesn't make much sense. Signed-off-by: Henning Garus <henning.garus@gmail.com> Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18Add "testing to repo" for any pkgs in communityDaniel J Griffiths
Whoops, missed this in the last commit Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18Add "testing to repo" scripts for communityDaniel J Griffiths
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18Add db-community-testingDaniel J Griffiths
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18ftpdir-cleanup: Additional getpkgname cleanupAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18ftpdir-cleanup: get rid of local getpkgnameAaron Griffin
This is in the db-functions file, and does a better job. In order to do this, we had to change some path related code Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18Collapse duplicate loops for staging removalAaron Griffin
Add 'any' to the items looped over in the ${ARCHES[@]} loop Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18Remove pkg from $stagedir if already in FTP repoFrancois Charette
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18added testing2...-any scriptsFrancois Charette
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18Remove '$arch' from file loopAaron Griffin
This allows us to still remove older, non architecture prefixed packages Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18Minor: remove unused variableAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-13Maybe I should make the script really adjust permissionsDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2009-09-13Ensure you don't update DBs on the wrong serverDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2009-09-13Add new get_repos_for_host() functionDan McGee
And use it. This allows us to have server-specific behavior in our scripts without further patching, and it also allows us to simplify some of our scripts a fair amount. Signed-off-by: Dan McGee <dan@archlinux.org>
2009-09-13Be more careful with config file inclusionDan McGee
We can't really do the basedir magic from db-functions as it is just being sourced and is not the currently executing script. Although a bit repetitive, it is a lot safer to just include the config file everywhere. Noticed this when trying to run the latest available scripts on sigurd. Signed-off-by: Dan McGee <dan@archlinux.org>
2009-09-08Added sourceballs.force entriesAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-01sourceballs: explicitly add the 'any' archAaron Griffin
Loop over all arches AND the 'any' arch. Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-28add deplist to hierarchy problemsXavier Chantry
This should help a lot figuring out whether a given hierarchy problem is fixable (if it doesn't require moving too many deps). example output core/crda depends on extra/python-m2crypto (27 extra (make)deps to pull) core/iputils depends on extra/opensp (29 extra (make)deps to pull) core/iputils depends on extra/libxslt (25 extra (make)deps to pull) core/iputils depends on extra/docbook-xsl (27 extra (make)deps to pull) core/udev depends on extra/gperf (0 extra (make)deps to pull) core/udev depends on extra/libxslt (25 extra (make)deps to pull) core/e2fsprogs depends on extra/bc (0 extra (make)deps to pull) core/sqlite3 depends on extra/tcl (0 extra (make)deps to pull) core/ca-certificates depends on extra/ruby (25 extra (make)deps to pull) the actual deps are only displayed when there are less than 10. Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-28check_packages : add support for split packages.Xavier Chantry
I just found a way to support split packages, by using $(type package_${pkg}), parsing that output and running eval on the relevant lines. This is a bit ugly, and while it works fine on my machine and my current abs tree, I cannot guarantee this code is bug free :) Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-25Quiet sourceball output when license is skippedAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-25Add SRCEXT to configAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-18Fix arch parameter handling in db-removeEric Bélanger
db-remove use the arch variable to handle the arch parameter passed to the script. As the arch variable is already used in PKGBUILD, this variable conflict cause unwanted behaviour. Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-18Replace pkgname with pkgbase, for split packagesAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-18Use db-functions file everywhereAaron Griffin
This source the config file and gets us functions such as getpkgname which were duplicated elsewhere Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-18More removal of DB_COMPRESSION from cron jobsAaron Griffin
Remove dependance on makepkg.conf Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-18More makepkg.conf removal - prefer toplevel configAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-18Remove find-dupes script (unused)Aaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-18Variable rename fix: SVN_PATH -> SVNREPOEric Bélanger
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-17Replace a string compare with a -f checkAaron Griffin
No real reason, this is just easier to understand, and checks like this should be the norm. If file does not exist, continue Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-17Fix an error in db-move due to DBEXT commitAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-17Remove dependence on makepkg.confAaron Griffin
Removed the need for makepkg.conf * Killed off CARCH * Added PKGEXT to the config file * Remove source_makepkg function * Source config file where makepkg.conf was needed Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-17Uncomment BUILDSCRIPT in the config fileAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-17Replace DB_COMPRESSION with DBEXT in the configAaron Griffin
DBEXT contains the full extension for the db files (.db.tar.gz) and is recorded in the config file Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-16Add DB_COMPRESSION var to all scripts that need itDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2009-08-16Add DB_COMPRESSION='gz', as this has been removed from makepkg.confThomas Bächler
2009-08-16Make ftpdir-cleanup NOT delete all packages if databas extraction failsThomas Bächler
2009-08-16Avoid confusing messages and potential problems when no packages are presentThomas Bächler
If no packages are present in the repository, a message like this will be generated, and the corresponding mv command will be issued. Prevent this by checking if *$arch$PKGEXT equals "*$arch$PKGEXT": Scan complete for core (i686) at /srv/ftp/core/os/i686 The following files are in the repo but not the db They will be moved to '/srv/package-cleanup' *i686.pkg.tar.gz
2009-08-03Add db-communityAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-03Remove community from stock ftpdir-cleanupAaron Griffin
community repo is cleaned up on a different machine Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-22ftpdir-cleanup: Loop over arches for 'any' linksAaron Griffin
Remove the hardcoded i686/x86_64 and loop over the ARCHES array in the config file, checking for valid symlinks. If none are found, remove the 'any' package Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-22ftpdir-cleanup: Minimize outputAaron Griffin
Clean up some output so when we do nothing, we get no output This is preferred as the mailer will simply not send a mail in this case. Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-22Use the top level config file for cron-jobsAaron Griffin
Source our config file, and use ARCHES from it Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-22remove support for different svn reposPierre Schmitz
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-21db-update: Move some steps inside an 'if'Francois Charette
[Aaron: keep WORKDIR creation outside the loop, as its removed at the end] Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-21Merge branch 'master' of /srv/projects/git/dbscriptsAaron Griffin
2009-07-21db-update: Fix final repo_unlockAaron Griffin
Because we lock/unlock in a loop, simply remove the cleanup trap at the end of the process, and manually clean up the work dir Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
generated by cgit v1.2.3-54-g00ecf (git 2.45.2) at 2024-11-19 14:22:37 +0000