1
0
mirror of https://git.FreeBSD.org/ports.git synced 2025-01-07 06:40:06 +00:00
Commit Graph

928 Commits

Author SHA1 Message Date
Mark Linimon
f1c9dc80e7 Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

Add the copying over of client.conf to the clients, and take care
to force the file copy regardless of whether it is a symlink.

Feature safe:	yes
2010-06-25 23:21:46 +00:00
Mark Linimon
6cbd9ecd57 Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

Several bugs are fixed and improvements are made:

 - the name of the journal is changed from 'make' (ew) to 'journal'.
 - 'cvsdate' is replaced by the more accurate name '.updated' and
   documentation adjusted to match.
 - make it more clear that '.updated' means 'ports tree updated'
   instead of 'src tree updated' (although the same filename is
   used for both).
 - correctly handle the general case of non-mainstream branches
   (e.g. "7-exp") without hardcoding "-exp".

Feature safe:	yes
2010-06-25 23:20:14 +00:00
Mark Linimon
31f34112f9 Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

Note: the major change is to require branch as an argument.  The
silly code that expected the branch to be passed via a symlinked
command such as 'dopackages.7' is removed.

Several bugs are fixed and improvements are made:

 - make the separation of 'date' and 'datestamp' clearer.
 - make handling of error conditions (e.g. for a first-time run
   where 'build create' has been forgotten) more obvious.

Feature safe:	yes
2010-06-25 23:16:46 +00:00
Mark Linimon
80e1a07ccb Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

Several bugs are fixed and improvements are made:

 - the name of the journal file is changed from 'make' (ew) to
   'journal'.
 - the 'date' parameter becomes 'datestamp' to delinate the script's
   uses of the date command vs. the parameter.  This is mostly for
   readability.
 - add the -nochecksubdirs option.  This is only useful for restarted
   or incremental runs.
 - refactor the error returns a bit.
 - exit gracefully if no INDEXFILE.
 - fix a bug in the 'packages built' logic that would return -2 if no
   packages were actually built.
 - change the misnamed 'cvsdone' file to '.updated'.
 - clean up the 'task waiting' logic.

Feature safe:	yes
2010-06-25 23:14:13 +00:00
Mark Linimon
f06078517f Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

Note that this script will now figure out 'branches' by itself, thus
removing the special-casing for '-exp'.

Feature safe:	yes
2010-06-25 23:08:14 +00:00
Mark Linimon
21fd819842 Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

Note: it is still not clear to me if this script is currently used.

Feature safe:	yes
2010-06-25 23:05:49 +00:00
Mark Linimon
ecc847e0d6 Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

While here, rework the code a bit to parameterize arch-specific tasks.

Feature safe:	yes
2010-06-25 23:04:53 +00:00
Mark Linimon
1629562d00 Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

While here, carefully document the origin of the values of the
environment variables that are passed in.

Feature safe:	yes
2010-06-25 23:03:11 +00:00
Mark Linimon
381f8cb94b Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

While here, do some cleanup.

Feature safe:	yes
2010-06-25 23:02:09 +00:00
Mark Linimon
75fda7ac40 Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

Several bugs are fixed and improvements are made:

 - the definitions for valid 'arch' and 'branch' are moved to
   server.conf.
 - the script is broken up into two pieces; the old 'buildenv' name
   becomes the server side, and 'buildenv.client' is add for the
   client side.  'buildenv.common' is what you would expect.  This
   makes the separation of what controls what more clear.
 - the concept of 'branch base' is generalized to match any pattern
   postpended with '-', thus removing the specialness of '-exp'.  More
   work remains on the other scripts to best take advantage of this.
 - as a corollary, 'branch' can also have '.' in it, e.g., 6.4.
 - the obsolete variables FTP_PASSIVE_MODE, PKGZIPCMD, and X_WINDOW_SYSTEM
   are removed.

Feature safe:	yes
2010-06-25 23:01:05 +00:00
Mark Linimon
2173088340 Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

Several bugs are fixed and improvements are made:

 - archive directories are created  if they do not exist.
 - the location of ZFS-based directories is generalized.
 - the special string "-exp" disappears.
 - handling of buildid is made more robust.

Feature safe:	yes
2010-06-25 22:55:00 +00:00
Mark Linimon
11ad804e71 Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

While here, fix a but in the handling of the 'all' case.

Feature safe:	yes
2010-06-25 22:51:05 +00:00
Mark Linimon
ae733423e0 Generalize the packge building scripts to be able to be run on more than
one 'head' node, rather than just pointyhat itself.

Constants are factored out into installation-specific files known as
portbuild/conf/server.conf and portbuild/conf/client.conf.  There is
only one server.conf file.  Individual <arch> directories may have
their own client.conf files, or may symlink to ../conf/client.conf.

This first set of files only gets the *.conf files and some cleanup.

Feature safe:	yes
2010-06-25 22:49:56 +00:00
Mark Linimon
73d56dd444 Variant of the allgohans script that does locking. This has been in
use on pointyhat for a while.

Feature safe:	yes
2010-06-25 22:31:00 +00:00
Mark Linimon
7f02f37b5d Note the files that shouldn't be checked into the repository (they
may contain private information).

Feature safe:	yes
2010-06-25 21:42:24 +00:00
Mark Linimon
0f99ddce2e Remove obsolete cruft that has not been used in several years.
Feature safe:	yes
2010-06-22 23:55:31 +00:00
Mark Linimon
e8f9e57eca A new file to document some generalization of scripts on a package
building server.  For security reasons, the scripts themselves will
not be checked in to this repository.

Please do not commit to this file without the approval of portmgr.

Feature safe:	yes
2010-06-22 23:48:07 +00:00
Mark Linimon
408042ec04 Some configuration information that is shipped to the clients of a
package building cluster.

Please do not commit to this file without the approval of portmgr.

Feature safe:	yes
2010-06-22 23:46:55 +00:00
Mark Linimon
8a1c53277f A new file to centralize definitions that apply to the the package nodes
used from a package building cluster.  This is part of a rewrite to remove
a great deal of hardcoding.

Please do not commit to this file without the approval of portmgr.

Feature safe:	yes
2010-06-22 23:46:06 +00:00
Mark Linimon
536fd89955 A new file to centralize definitions that apply to the server-side of
a package building cluster.  This is part of a rewrite to remove a great
deal of hardcoding.

Please do not commit to this file without the approval of portmgr.

Feature safe:	yes
2010-06-22 23:45:27 +00:00
Mark Linimon
aa7717e661 Catch up with master copy on pointyhat.
Note: all 3 of these files will be changing radically in the near future.
This is the last checkin from the "classic" codebase installation.

Feature safe:	yes
2010-06-22 02:51:54 +00:00
Mark Linimon
7ce566ebb0 These appear to no longer be used.
Feature safe:	yes
2010-06-22 02:45:41 +00:00
Romain Tartière
4a54a88a4f - Unbreak the -n flag;
- Remove invalid reference to freefall.

Approved by:	garga
2010-06-06 09:30:54 +00:00
Mark Linimon
666d694375 Restore line dropped in revision 1.21.
Pointyhat to:		linimon
2010-06-03 07:01:35 +00:00
Mark Linimon
fa2be9ee8b Sigh. This had already been done, just not checked out on production.
Pointy hat:	self
2010-05-31 20:06:08 +00:00
Mark Linimon
dcabe96b55 Get rid of the remnants of X11BASE. 2010-05-31 20:01:31 +00:00
Mark Linimon
69105de3df Remove some hardcoding. 2010-05-31 19:33:22 +00:00
Mark Linimon
74affe36b5 Add a comment. 2010-05-31 19:29:25 +00:00
Mark Linimon
05e815f4bd Eliminate some more hardcoding. Expand the pattern for "non-mainstream"
builds to also catch \., not just \-.
2010-05-25 20:08:56 +00:00
Mark Linimon
ed6716f76f Remove the hard-coding of '-exp'. While here, factor out some other
hardcoding to defines.
2010-05-25 07:37:48 +00:00
Mark Linimon
9672ea0555 Remove obsolete cruft. 2010-05-23 03:09:09 +00:00
Mark Linimon
a9c84913e9 Cronjob that runs on pointyhat to cleanup stale chroots on clients. 2010-05-22 00:58:11 +00:00
Mark Linimon
4a1e5c660e Trim backup files a bit; make the emails a bit more verbose. 2010-05-20 04:07:13 +00:00
Mark Linimon
b5b4dafb6f Refactor things a bit. 2010-05-20 04:04:24 +00:00
Mark Linimon
44bd147989 Improve error handling a bit. 2010-05-20 03:58:50 +00:00
Erwin Lansing
ad1b924b23 Revert the clang part of rev 1.12, which is now default in clangbsd. 2010-05-10 15:05:59 +00:00
Mark Linimon
7fc55a84af Add a case to detect a transient problem that shows up on all package
nodes, but most regularly on sparc64.  (Occasionally, on amd64 and ia64).

For reasons I haven't been quite able to track down, on some occasions
a pkg_add command is unable to extract a dependency; the tarfile shows
up as being truncated.  This does not seem to be due to disk-low or
memory-low conditions, nor is it a problem with scp; the md5 on the file
is fine when examined afterwards.

The only clue so far is that it seems to happen on systems with the most
package builds running simultaneously -- and thus, possibly more than one
pkg_add running in parallel.
2010-03-30 21:19:36 +00:00
Mark Linimon
5c7fe20b5f Add an entry for the "truncated distfiles" problem; improve one other entry. 2010-03-30 21:14:16 +00:00
Dirk Meyer
5e55949069 - allow addport to work in ports-mgnt again
Approved by:	garga, drso, flz
2010-03-25 15:44:17 +00:00
Mark Linimon
81ee5011c8 Catch up with production.
Feature safe:	yes
2010-02-19 16:27:24 +00:00
Mark Linimon
2492e191ee Bring this up to date with what is in production: add 'queue length'
column from pav; fix first-column formatting.

Feature safe:	yes
2010-02-19 16:15:58 +00:00
Mark Linimon
261bae1be6 Bah, another few references to "8-current", which no longer exists. 2010-02-05 18:09:52 +00:00
Jun Kuriyama
e2f30d68c5 - Add a script to check unneeded dependencies for perl modules. 2010-01-29 14:52:45 +00:00
Mark Linimon
d1c3f4ddd2 Add some new error cases to handle regressions in -current. (Not yet
analyzed for how much they will slow this script down; consider this a
rush-job.)

 - dirent denotes some change in the usage of dirent.h.
 - termios denotes the deprecation of <sys/termios.h>.
 - uname denotes the hiding of the uname symbol.  This has been backed
   out in src so let's hope this case can go away soon.
 - utmp_x denotes the replacement of utmp.h with utmpx.h.

Together these catch ~150 new errors on i386-9.  However, there are more
that are not caught (second-order effects.)
2010-01-20 09:08:55 +00:00
Mark Linimon
99e391bf77 Note that we are at 9-CURRENT now. Also, ia64 builds have resumed. 2009-12-19 14:05:51 +00:00
Pav Lucistnik
931cab63a3 - Remove use of X11BASE from pointyhat scripts 2009-12-18 14:25:58 +00:00
Maxim Sobolev
4ba8d15977 Correct depreciation warning with Python 2.6 and fix several warnings
from the pytchecker.
2009-11-21 00:40:59 +00:00
Mark Linimon
7676829042 A few more loose ends.
Testing by:	miwi
2009-11-19 06:47:05 +00:00
Mark Linimon
a7e34a9e41 Make the create command more robust by making even more directories
and checking more error results.
2009-11-19 03:25:47 +00:00
Mark Linimon
4bf33692a7 Properly supppress empty buildenvs. 2009-11-17 04:49:41 +00:00