From mbligh@google.com Tue Aug 22 09:29:08 2006 Return-Path: X-Original-To: brandon@osuosl.org Delivered-To: philips@osuosl.org Received: from ns1.osuosl.org (ns1.osuosl.org [140.211.166.130]) by shell.osuosl.org (Postfix) with ESMTP id CCC8E62C0D7 for ; Tue, 22 Aug 2006 09:29:08 -0700 (PDT) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns1.osuosl.org (Postfix) with ESMTP id B3EF63368B4 for ; Tue, 22 Aug 2006 09:29:08 -0700 (PDT) Received: from ns1.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 07124-57 for ; Tue, 22 Aug 2006 09:28:57 -0700 (PDT) Received: from secure.lairdnovak.com (jackass2.lairdnovak.com [64.34.179.15]) by ns1.osuosl.org (Postfix) with ESMTP id C0B1D33683E for ; Tue, 22 Aug 2006 09:28:56 -0700 (PDT) Received: by secure.lairdnovak.com (Postfix) id 70A2C6581A3; Tue, 22 Aug 2006 16:28:56 +0000 (UTC) Delivered-To: philips@secure.lairdnovak.com Received: from ns1.osuosl.org (ns1.osuosl.org [140.211.166.130]) by secure.lairdnovak.com (Postfix) with ESMTP id 36B8B658194 for ; Tue, 22 Aug 2006 16:28:56 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns1.osuosl.org (Postfix) with ESMTP id C8A2F336863 for ; Tue, 22 Aug 2006 09:28:55 -0700 (PDT) Received: from ns1.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 08176-78 for ; Tue, 22 Aug 2006 09:28:43 -0700 (PDT) Received: from smtp-out.google.com (smtp-out.google.com [216.239.45.12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ns1.osuosl.org (Postfix) with ESMTP id 1A02633683E for ; Tue, 22 Aug 2006 09:28:43 -0700 (PDT) Received: from zps78.corp.google.com (zps78.corp.google.com [172.25.146.78]) by smtp-out.google.com with ESMTP id k7MGSTY9005923; Tue, 22 Aug 2006 09:28:33 -0700 DomainKey-Signature: a=rsa-sha1; s=beta; d=google.com; c=nofws; q=dns; h=received:message-id:date:from:user-agent:mime-version:to:cc: subject:references:in-reply-to:content-type:content-transfer-encoding; b=e0Eu0BLEE/OOYiwP7WbzCz75hBNMvq99Z06favuSI++qRzFrKodxqPwjdzzCDog60 a2+sMOjps+tWsEhEsBauA== Received: from smtp.corp.google.com (baraddur.corp.google.com [192.168.15.228]) by zps78.corp.google.com with ESMTP id k7MGSNEF009245 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Tue, 22 Aug 2006 09:28:23 -0700 Received: from [10.10.1.2] ([67.170.239.34]) (authenticated bits=0) by smtp.corp.google.com (8.13.7/8.13.6) with ESMTP id k7MGSMrC003430 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Tue, 22 Aug 2006 09:28:23 -0700 Message-ID: <44EB309C.4060109@google.com> Date: Tue, 22 Aug 2006 09:28:12 -0700 From: "Martin J. Bligh" User-Agent: Thunderbird 1.5.0.5 (X11/20060728) MIME-Version: 1.0 To: Brandon Philips Cc: autotest@test-kernel.osuosl.org Subject: Re: [Autotest] [PATCH] Add CK's interbench References: <20060821223827.GA5291@vnet.ibm.com> In-Reply-To: <20060821223827.GA5291@vnet.ibm.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.6 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.6 tagged_above=-999.0 required=5.0 tests=BAYES_00 X-Spam-Level: Status: RO Content-Length: 2208 Brandon Philips wrote: > This patch adds a harness for CK's interactivity benchmark. Looks good, applied. Thanks! M. > NOTE: interbench-0.30.tar.bz2 not included in the patch > http://www.kernel.org/pub/linux/kernel/people/ck/apps/interbench/interbench-0.30.tar.bz2 > > --- > tests/interbench/control | 1 + > tests/interbench/interbench-0.30.tar.bz2 | Bin > tests/interbench/interbench.py | 28 ++++++++++++++++++++++++++++ > 3 files changed, 29 insertions(+), 0 deletions(-) > > diff --git a/tests/interbench/control b/tests/interbench/control > new file mode 100644 > index 0000000..1b77dfd > --- /dev/null > +++ b/tests/interbench/control > @@ -0,0 +1 @@ > +job.runtest(None, 'interbench') > diff --git a/tests/interbench/interbench-0.30.tar.bz2 b/tests/interbench/interbench-0.30.tar.bz2 > new file mode 100644 > index 0000000..275d99b > Binary files /dev/null and b/tests/interbench/interbench-0.30.tar.bz2 differ > diff --git a/tests/interbench/interbench.py b/tests/interbench/interbench.py > new file mode 100755 > index 0000000..db7c28b > --- /dev/null > +++ b/tests/interbench/interbench.py > @@ -0,0 +1,28 @@ > +import test > +from autotest_utils import * > + > +class interbench(test.test): > + version = 1 > + > + # http://www.kernel.org/pub/linux/kernel/people/ck/apps/interbench/interbench-0.30.tar.bz2 > + def setup(self, tarball = 'interbench-0.30.tar.bz2'): > + tarball = unmap_url(self.bindir, tarball, self.tmpdir) > + extract_tarball_to_dir(tarball, self.srcdir) > + os.chdir(self.srcdir) > + > + system('make') > + > + def execute(self, iterations = 1, args = ''): > + os.chdir(self.resultsdir) > + for i in range(1, iterations+1): > + system(self.srcdir + '/interbench -m \'run #%s\'' % i \ > + + args) > + > + # Do a profiling run if necessary > + profilers = self.job.profilers > + if profilers.present(): > + profilers.start(self) > + system(self.srcdir + './interbench \'profile run\'' \ > + + args) > + profilers.stop(self) > + profilers.report(self) > _______________________________________________ > Autotest mailing list > Autotest@test.kernel.org > http://test.kernel.org/cgi-bin/mailman/listinfo/autotest From mbligh@google.com Tue Aug 22 10:05:05 2006 Return-Path: X-Original-To: brandon@osuosl.org Delivered-To: philips@osuosl.org Received: from ns1.osuosl.org (ns1.osuosl.org [140.211.166.130]) by shell.osuosl.org (Postfix) with ESMTP id E5B7862C0D7 for ; Tue, 22 Aug 2006 10:05:05 -0700 (PDT) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns1.osuosl.org (Postfix) with ESMTP id 30926336869 for ; Tue, 22 Aug 2006 10:05:05 -0700 (PDT) Received: from ns1.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 18848-15 for ; Tue, 22 Aug 2006 10:05:03 -0700 (PDT) Received: from secure.lairdnovak.com (jackass2.lairdnovak.com [64.34.179.15]) by ns1.osuosl.org (Postfix) with ESMTP id C1567336665 for ; Tue, 22 Aug 2006 10:05:03 -0700 (PDT) Received: by secure.lairdnovak.com (Postfix) id 745C16581A2; Tue, 22 Aug 2006 17:05:03 +0000 (UTC) Delivered-To: philips@secure.lairdnovak.com Received: from ns1.osuosl.org (ns1.osuosl.org [140.211.166.130]) by secure.lairdnovak.com (Postfix) with ESMTP id 4EC3265813A for ; Tue, 22 Aug 2006 17:05:03 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns1.osuosl.org (Postfix) with ESMTP id DC550336665 for ; Tue, 22 Aug 2006 10:05:02 -0700 (PDT) Received: from ns1.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 18198-28 for ; Tue, 22 Aug 2006 10:04:56 -0700 (PDT) Received: from smtp-out.google.com (smtp-out.google.com [216.239.45.12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ns1.osuosl.org (Postfix) with ESMTP id 9269E336869 for ; Tue, 22 Aug 2006 10:04:56 -0700 (PDT) Received: from zps38.corp.google.com (zps38.corp.google.com [172.25.146.38]) by smtp-out.google.com with ESMTP id k7MH4nH3029415; Tue, 22 Aug 2006 10:04:49 -0700 DomainKey-Signature: a=rsa-sha1; s=beta; d=google.com; c=nofws; q=dns; h=received:message-id:date:from:user-agent: x-accept-language:mime-version:to:cc:subject:references:in-reply-to: content-type:content-transfer-encoding; b=HoKma41pomGex5DKKOoKjwyIp1ABdA2dbYJUbKGR4tTNcJIpq5tasKvmbIfNp6Rvi xvaFEWi/ZuFBVmyudIe2Q== Received: from [172.18.108.59] (mbligh.corp.google.com [172.18.108.59]) by zps38.corp.google.com with ESMTP id k7MH4hpW023551; Tue, 22 Aug 2006 10:04:43 -0700 Message-ID: <44EB392B.5060204@google.com> Date: Tue, 22 Aug 2006 10:04:43 -0700 From: Martin Bligh User-Agent: Mozilla Thunderbird 1.0.7 (X11/20051011) X-Accept-Language: en-us, en MIME-Version: 1.0 To: Brandon Philips Cc: autotest@test-kernel.osuosl.org Subject: Re: [Autotest] [PATCH] tests/sleeptest/control broken: sleep -> sleeptest References: <20060822153419.GB5291@vnet.ibm.com> In-Reply-To: <20060822153419.GB5291@vnet.ibm.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.5 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.5 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: Status: RO Content-Length: 391 Oops, applied. Thanks, M. Brandon Philips wrote: > --- > tests/sleeptest/control | 2 +- > 1 files changed, 1 insertions(+), 1 deletions(-) > > diff --git a/tests/sleeptest/control b/tests/sleeptest/control > index 00217d7..439dded 100644 > --- a/tests/sleeptest/control > +++ b/tests/sleeptest/control > @@ -1 +1 @@ > -job.runtest(None, 'sleep') > +job.runtest(None, 'sleeptest') From mbligh@google.com Sun Aug 27 09:57:35 2006 Return-Path: X-Original-To: brandon@osuosl.org Delivered-To: philips@osuosl.org Received: from ns1.osuosl.org (ns1.osuosl.org [140.211.166.130]) by shell.osuosl.org (Postfix) with ESMTP id 72F9C62C0D7 for ; Sun, 27 Aug 2006 09:57:35 -0700 (PDT) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns1.osuosl.org (Postfix) with ESMTP id 2694933686A for ; Sun, 27 Aug 2006 09:57:35 -0700 (PDT) Received: from ns1.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 25683-15 for ; Sun, 27 Aug 2006 09:57:26 -0700 (PDT) Received: from secure.lairdnovak.com (jackass2.lairdnovak.com [64.34.179.15]) by ns1.osuosl.org (Postfix) with ESMTP id 06F28336666 for ; Sun, 27 Aug 2006 09:57:26 -0700 (PDT) Received: by secure.lairdnovak.com (Postfix) id B5A0B658217; Sun, 27 Aug 2006 16:57:25 +0000 (UTC) Delivered-To: philips@secure.lairdnovak.com Received: from ns1.osuosl.org (ns1.osuosl.org [140.211.166.130]) by secure.lairdnovak.com (Postfix) with ESMTP id 994BC6581A6 for ; Sun, 27 Aug 2006 16:57:25 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns1.osuosl.org (Postfix) with ESMTP id 3B72F33686A for ; Sun, 27 Aug 2006 09:57:25 -0700 (PDT) Received: from ns1.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 19528-40 for ; Sun, 27 Aug 2006 09:57:20 -0700 (PDT) Received: from smtp-out.google.com (smtp-out.google.com [216.239.45.12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ns1.osuosl.org (Postfix) with ESMTP id 974AB336666 for ; Sun, 27 Aug 2006 09:57:20 -0700 (PDT) Received: from zps36.corp.google.com (zps36.corp.google.com [172.25.146.36]) by smtp-out.google.com with ESMTP id k7RGvIs5010230; Sun, 27 Aug 2006 09:57:18 -0700 DomainKey-Signature: a=rsa-sha1; s=beta; d=google.com; c=nofws; q=dns; h=received:message-id:date:from:user-agent:mime-version:to:cc: subject:references:in-reply-to:content-type:content-transfer-encoding; b=kEybvg7n8eHmugeqLH0ouJfEKRlukHypA3bZxcWl2ii4uGgsQobL8UbGF2MYHZNb2 n+nDXdexeBmHvQ2L0y4Rg== Received: from smtp.corp.google.com (baraddur.corp.google.com [192.168.15.228]) by zps36.corp.google.com with ESMTP id k7RGvHMn031505 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Sun, 27 Aug 2006 09:57:17 -0700 Received: from [10.10.1.2] ([67.170.239.34]) (authenticated bits=0) by smtp.corp.google.com (8.13.7/8.13.6) with ESMTP id k7RGvGou005740 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Sun, 27 Aug 2006 09:57:17 -0700 Message-ID: <44F1CEC9.3020509@google.com> Date: Sun, 27 Aug 2006 09:56:41 -0700 From: "Martin J. Bligh" User-Agent: Thunderbird 1.5.0.5 (X11/20060728) MIME-Version: 1.0 To: Brandon Philips Cc: autotest@test-kernel.osuosl.org Subject: Re: [Autotest] [PATCH] tests/sleeptest/control broken: sleep -> sleeptest References: <20060822153419.GB5291@vnet.ibm.com> In-Reply-To: <20060822153419.GB5291@vnet.ibm.com> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.6 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.6 tagged_above=-999.0 required=5.0 tests=BAYES_00 X-Spam-Level: Status: RO Content-Length: 529 Lines: 18 Brandon Philips wrote: > --- > tests/sleeptest/control | 2 +- > 1 files changed, 1 insertions(+), 1 deletions(-) > > diff --git a/tests/sleeptest/control b/tests/sleeptest/control > index 00217d7..439dded 100644 > --- a/tests/sleeptest/control > +++ b/tests/sleeptest/control > @@ -1 +1 @@ > -job.runtest(None, 'sleep') > +job.runtest(None, 'sleeptest') > _______________________________________________ > Autotest mailing list > Autotest@test.kernel.org > http://test.kernel.org/cgi-bin/mailman/listinfo/autotest applied From mbligh@google.com Mon Aug 28 21:58:09 2006 Return-Path: X-Original-To: brandon@osuosl.org Delivered-To: philips@osuosl.org Received: from ns2.osuosl.org (ns2.osuosl.org [140.211.166.131]) by shell.osuosl.org (Postfix) with ESMTP id 44A8A62C0D7 for ; Mon, 28 Aug 2006 21:58:09 -0700 (PDT) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns2.osuosl.org (Postfix) with ESMTP id 9DD3E122E82 for ; Mon, 28 Aug 2006 22:56:53 -0700 (PDT) Received: from ns2.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 05892-53 for ; Mon, 28 Aug 2006 22:56:53 -0700 (PDT) Received: from secure.lairdnovak.com (jackass2.lairdnovak.com [64.34.179.15]) by ns2.osuosl.org (Postfix) with ESMTP id 6A661122E14 for ; Mon, 28 Aug 2006 22:56:53 -0700 (PDT) Received: by secure.lairdnovak.com (Postfix) id 9D3E0658250; Tue, 29 Aug 2006 04:58:08 +0000 (UTC) Delivered-To: philips@secure.lairdnovak.com Received: from ns2.osuosl.org (ns2.osuosl.org [140.211.166.131]) by secure.lairdnovak.com (Postfix) with ESMTP id 4E0FA65813C for ; Tue, 29 Aug 2006 04:58:08 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns2.osuosl.org (Postfix) with ESMTP id 4537A122E98 for ; Mon, 28 Aug 2006 22:56:52 -0700 (PDT) Received: from ns2.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 05892-52 for ; Mon, 28 Aug 2006 22:56:47 -0700 (PDT) Received: from smtp-out.google.com (smtp-out.google.com [216.239.45.12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ns2.osuosl.org (Postfix) with ESMTP id 7E894122E8B for ; Mon, 28 Aug 2006 22:56:47 -0700 (PDT) Received: from zps38.corp.google.com (zps38.corp.google.com [172.25.146.38]) by smtp-out.google.com with ESMTP id k7T4w0mI023007; Mon, 28 Aug 2006 21:58:00 -0700 DomainKey-Signature: a=rsa-sha1; s=beta; d=google.com; c=nofws; q=dns; h=received:message-id:date:from:user-agent:mime-version:to:cc: subject:references:in-reply-to:content-type:content-transfer-encoding; b=jQR6x3cNUN86kRvA+/DCDWr6pVfngIlhgz1t+qsagkG2JmSJdbC6jVP1IjRnMOBAB rau+96tkn0kkxz4PZ0J4A== Received: from smtp.corp.google.com (baraddur.corp.google.com [192.168.15.228]) by zps38.corp.google.com with ESMTP id k7T4vv4V028544 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Mon, 28 Aug 2006 21:57:57 -0700 Received: from [10.10.1.2] ([67.170.239.34]) (authenticated bits=0) by smtp.corp.google.com (8.13.7/8.13.6) with ESMTP id k7T4vujP007079 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Mon, 28 Aug 2006 21:57:56 -0700 Message-ID: <44F3C929.30304@google.com> Date: Mon, 28 Aug 2006 21:57:13 -0700 From: "Martin J. Bligh" User-Agent: Thunderbird 1.5.0.5 (X11/20060728) MIME-Version: 1.0 To: Brandon Philips Cc: autotest@test-kernel.osuosl.org Subject: Re: [Autotest] [PATCH] Comment out debugging statements in tee_redirect References: <20060822211913.GD5291@vnet.ibm.com> In-Reply-To: <20060822211913.GD5291@vnet.ibm.com> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.6 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.6 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: Status: RO Content-Length: 1242 Lines: 42 Brandon Philips wrote: > Signed-off-by: Brandon Philips Oops ;-( Applied, thanks. > --- > bin/autotest_utils.py | 8 ++++---- > 1 files changed, 4 insertions(+), 4 deletions(-) > > diff --git a/bin/autotest_utils.py b/bin/autotest_utils.py > index 7ddd411..3033a66 100755 > --- a/bin/autotest_utils.py > +++ b/bin/autotest_utils.py > @@ -342,8 +342,8 @@ class fd_stack: > > Overwrites the previous contents, if any. > """ > - print_to_tty("tee_redirect to " + filename) > - where_art_thy_filehandles() > + #print_to_tty("tee_redirect to " + filename) > + #where_art_thy_filehandles() > fdcopy = os.dup(self.fd) > self.stack.append( (fdcopy, self.filehandle) ) > r, w = os.pipe() > @@ -358,8 +358,8 @@ class fd_stack: > os.dup2(2, 1) > os.execlp('tee', 'tee', filename) > self.filehandle = os.fdopen(self.fd, 'w') > - where_art_thy_filehandles() > - print_to_tty("done tee_redirect to " + filename) > + #where_art_thy_filehandles() > + #print_to_tty("done tee_redirect to " + filename) > > > def restore(self): > _______________________________________________ > Autotest mailing list > Autotest@test.kernel.org > http://test.kernel.org/cgi-bin/mailman/listinfo/autotest From mbligh@google.com Mon Aug 28 22:02:14 2006 Return-Path: X-Original-To: brandon@osuosl.org Delivered-To: philips@osuosl.org Received: from ns1.osuosl.org (ns1.osuosl.org [140.211.166.130]) by shell.osuosl.org (Postfix) with ESMTP id C401F62C0D7 for ; Mon, 28 Aug 2006 22:02:14 -0700 (PDT) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns1.osuosl.org (Postfix) with ESMTP id A8DEF3367E6 for ; Mon, 28 Aug 2006 22:02:13 -0700 (PDT) Received: from ns1.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 21156-34 for ; Mon, 28 Aug 2006 22:02:04 -0700 (PDT) Received: from secure.lairdnovak.com (jackass2.lairdnovak.com [64.34.179.15]) by ns1.osuosl.org (Postfix) with ESMTP id BBA88336807 for ; Mon, 28 Aug 2006 22:02:03 -0700 (PDT) Received: by secure.lairdnovak.com (Postfix) id 78ABF658250; Tue, 29 Aug 2006 05:02:03 +0000 (UTC) Delivered-To: philips@secure.lairdnovak.com Received: from ns1.osuosl.org (ns1.osuosl.org [140.211.166.130]) by secure.lairdnovak.com (Postfix) with ESMTP id 6343A65813C for ; Tue, 29 Aug 2006 05:02:03 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns1.osuosl.org (Postfix) with ESMTP id 3D93F336808 for ; Mon, 28 Aug 2006 22:02:02 -0700 (PDT) Received: from ns1.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 07945-84-2 for ; Mon, 28 Aug 2006 22:01:57 -0700 (PDT) Received: from smtp-out.google.com (smtp-out.google.com [216.239.45.12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ns1.osuosl.org (Postfix) with ESMTP id 5B5D9336807 for ; Mon, 28 Aug 2006 22:01:56 -0700 (PDT) Received: from zps77.corp.google.com (zps77.corp.google.com [172.25.146.77]) by smtp-out.google.com with ESMTP id k7T51rJk015116; Mon, 28 Aug 2006 22:01:53 -0700 DomainKey-Signature: a=rsa-sha1; s=beta; d=google.com; c=nofws; q=dns; h=received:message-id:date:from:user-agent:mime-version:to:cc: subject:references:in-reply-to:content-type:content-transfer-encoding; b=Wk2vms+DL+lTELDQh2eDcpP1+fPnZY1a1zXbZ6cf6ELZVclLEL58PXjGrZwuhoSV7 eoNLg0VR4NxUyAhsHSSjw== Received: from smtp.corp.google.com (mordor.corp.google.com [192.168.15.226]) by zps77.corp.google.com with ESMTP id k7T51o6l029755 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Mon, 28 Aug 2006 22:01:50 -0700 Received: from [10.10.1.2] ([67.170.239.34]) (authenticated bits=0) by smtp.corp.google.com (8.13.7/8.13.7) with ESMTP id k7T51nwL025882 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Mon, 28 Aug 2006 22:01:50 -0700 Message-ID: <44F3CA13.1040608@google.com> Date: Mon, 28 Aug 2006 22:01:07 -0700 From: "Martin J. Bligh" User-Agent: Thunderbird 1.5.0.5 (X11/20060728) MIME-Version: 1.0 To: Brandon Philips Cc: Paul Jimenez , autotest@test-kernel.osuosl.org Subject: Re: [Autotest] [PATCH] Fix several interbench issues References: <20060823201523.GF5291@vnet.ibm.com> <20060823221451.4287F8220@place.org> <20060828212737.GA29145@vnet.ibm.com> In-Reply-To: <20060828212737.GA29145@vnet.ibm.com> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.6 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.6 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: Status: RO Content-Length: 1535 Lines: 46 Brandon Philips wrote: > - add space before args so they work > - remove . in profiler run path, this breaks the run. Oops. > - use tmpdir and add -c to supress the log. tee_redirect now grabs the results. Applied. (skipped previous generation of this patch). > Signed-off-by: Brandon Philips > > --- > tests/interbench/interbench.py | 12 +++++++----- > 1 files changed, 7 insertions(+), 5 deletions(-) > > diff --git a/tests/interbench/interbench.py b/tests/interbench/interbench.py > index db7c28b..bcad9b5 100644 > --- a/tests/interbench/interbench.py > +++ b/tests/interbench/interbench.py > @@ -13,16 +13,18 @@ class interbench(test.test): > system('make') > > def execute(self, iterations = 1, args = ''): > - os.chdir(self.resultsdir) > + os.chdir(self.tmpdir) > + args += " -c" > + > for i in range(1, iterations+1): > - system(self.srcdir + '/interbench -m \'run #%s\'' % i \ > - + args) > + system("%s/interbench -m 'run #%s' %s" % \ > + (self.srcdir, i, args)) > > # Do a profiling run if necessary > profilers = self.job.profilers > if profilers.present(): > profilers.start(self) > - system(self.srcdir + './interbench \'profile run\'' \ > - + args) > + system("%s/interbench -m 'profile run' %s" % \ > + (self.srcdir, args)) > profilers.stop(self) > profilers.report(self) > _______________________________________________ > Autotest mailing list > Autotest@test.kernel.org > http://test.kernel.org/cgi-bin/mailman/listinfo/autotest From mbligh@google.com Mon Aug 28 23:12:50 2006 Return-Path: X-Original-To: brandon@osuosl.org Delivered-To: philips@osuosl.org Received: from ns1.osuosl.org (ns1.osuosl.org [140.211.166.130]) by shell.osuosl.org (Postfix) with ESMTP id 29AEA62C0D7 for ; Mon, 28 Aug 2006 23:12:50 -0700 (PDT) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns1.osuosl.org (Postfix) with ESMTP id 0EA2C33681B for ; Mon, 28 Aug 2006 23:12:50 -0700 (PDT) Received: from ns1.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 28023-14 for ; Mon, 28 Aug 2006 23:12:48 -0700 (PDT) Received: from secure.lairdnovak.com (jackass2.lairdnovak.com [64.34.179.15]) by ns1.osuosl.org (Postfix) with ESMTP id A6F94336807 for ; Mon, 28 Aug 2006 23:12:48 -0700 (PDT) Received: by secure.lairdnovak.com (Postfix) id 60C76658299; Tue, 29 Aug 2006 06:12:48 +0000 (UTC) Delivered-To: philips@secure.lairdnovak.com Received: from ns1.osuosl.org (ns1.osuosl.org [140.211.166.130]) by secure.lairdnovak.com (Postfix) with ESMTP id 4967D658195 for ; Tue, 29 Aug 2006 06:12:48 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns1.osuosl.org (Postfix) with ESMTP id D93BD336807 for ; Mon, 28 Aug 2006 23:12:47 -0700 (PDT) Received: from ns1.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 28713-17 for ; Mon, 28 Aug 2006 23:12:41 -0700 (PDT) Received: from smtp-out.google.com (smtp-out.google.com [216.239.45.12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ns1.osuosl.org (Postfix) with ESMTP id 2CAE533681B for ; Mon, 28 Aug 2006 23:12:41 -0700 (PDT) Received: from zps38.corp.google.com (zps38.corp.google.com [172.25.146.38]) by smtp-out.google.com with ESMTP id k7T6CeWg018189; Mon, 28 Aug 2006 23:12:40 -0700 DomainKey-Signature: a=rsa-sha1; s=beta; d=google.com; c=nofws; q=dns; h=received:message-id:date:from:user-agent:mime-version:to:cc: subject:references:in-reply-to:content-type:content-transfer-encoding; b=JF63O+P8qcn18soVNqhwm3C0eRRS6r51oTlBbJ/nfS0EyWiEtINkez+USggTy313G d7wssgHqACMaknEFI83+g== Received: from smtp.corp.google.com (baraddur.corp.google.com [192.168.15.228]) by zps38.corp.google.com with ESMTP id k7T6CYj4011817 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Mon, 28 Aug 2006 23:12:35 -0700 Received: from [10.10.1.2] ([67.170.239.34]) (authenticated bits=0) by smtp.corp.google.com (8.13.7/8.13.6) with ESMTP id k7T6CYvK022112 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Mon, 28 Aug 2006 23:12:34 -0700 Message-ID: <44F3DAA7.3050608@google.com> Date: Mon, 28 Aug 2006 23:11:51 -0700 From: "Martin J. Bligh" User-Agent: Thunderbird 1.5.0.5 (X11/20060728) MIME-Version: 1.0 To: Brandon Philips Cc: autotest@test-kernel.osuosl.org Subject: Re: [Autotest] [PATCH] Add tee_redirect to test::__exec to save stdout, stderr of tests References: <20060822210942.GC5291@vnet.ibm.com> In-Reply-To: <20060822210942.GC5291@vnet.ibm.com> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.6 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.6 tagged_above=-999.0 required=5.0 tests=BAYES_00 X-Spam-Level: Status: RO Content-Length: 849 Lines: 35 Brandon Philips wrote: > Signed-off-by: Brandon Philips > > --- > bin/test.py | 8 ++++++++ > 1 files changed, 8 insertions(+), 0 deletions(-) > > diff --git a/bin/test.py b/bin/test.py > index f095953..a1c7f79 100755 > --- a/bin/test.py > +++ b/bin/test.py > @@ -67,8 +67,16 @@ class test: > > def __exec(self, parameters): > try: > + self.job.stdout.tee_redirect( > + os.path.join(self.debugdir, 'stdout')) > + self.job.stderr.tee_redirect( > + os.path.join(self.debugdir, 'stderr')) > + > os.chdir(self.outputdir) > self.execute(*parameters) > + > + self.job.stdout.restore() > + self.job.stderr.restore() > except AutotestError: > raise > except: Thankyou - does exactly what I'd intended it to do, and never got round to hooking it up. Tested, seems to work great. Applied. M. From mbligh@google.com Mon Aug 28 23:19:33 2006 Return-Path: X-Original-To: brandon@osuosl.org Delivered-To: philips@osuosl.org Received: from ns2.osuosl.org (ns2.osuosl.org [140.211.166.131]) by shell.osuosl.org (Postfix) with ESMTP id 2952F62C0D7 for ; Mon, 28 Aug 2006 23:19:33 -0700 (PDT) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns2.osuosl.org (Postfix) with ESMTP id 1FEF3122F8E for ; Tue, 29 Aug 2006 00:18:17 -0700 (PDT) Received: from ns2.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 24524-12 for ; Tue, 29 Aug 2006 00:18:07 -0700 (PDT) Received: from secure.lairdnovak.com (jackass2.lairdnovak.com [64.34.179.15]) by ns2.osuosl.org (Postfix) with ESMTP id 4A27C122E92 for ; Tue, 29 Aug 2006 00:18:07 -0700 (PDT) Received: by secure.lairdnovak.com (Postfix) id 6C810658299; Tue, 29 Aug 2006 06:19:22 +0000 (UTC) Delivered-To: philips@secure.lairdnovak.com Received: from ns1.osuosl.org (ns1.osuosl.org [140.211.166.130]) by secure.lairdnovak.com (Postfix) with ESMTP id 3EAA2658195 for ; Tue, 29 Aug 2006 06:19:22 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns1.osuosl.org (Postfix) with ESMTP id D289A336815 for ; Mon, 28 Aug 2006 23:19:21 -0700 (PDT) Received: from ns1.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 23739-64 for ; Mon, 28 Aug 2006 23:19:12 -0700 (PDT) Received: from smtp-out.google.com (smtp-out.google.com [216.239.45.12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ns1.osuosl.org (Postfix) with ESMTP id 419D93367E8 for ; Mon, 28 Aug 2006 23:19:12 -0700 (PDT) Received: from zps75.corp.google.com (zps75.corp.google.com [172.25.146.75]) by smtp-out.google.com with ESMTP id k7T6J7Bm021666; Mon, 28 Aug 2006 23:19:07 -0700 DomainKey-Signature: a=rsa-sha1; s=beta; d=google.com; c=nofws; q=dns; h=received:message-id:date:from:user-agent:mime-version:to:cc: subject:references:in-reply-to:content-type:content-transfer-encoding; b=kavS1lak9ZKfgo4PWAjxehRek5QoO2wriQUYudimXmuR83KpmIJ93tKXN2eCHzIiY YlXYn/owDyvxA5A7L5jAA== Received: from smtp.corp.google.com (baraddur.corp.google.com [192.168.15.228]) by zps75.corp.google.com with ESMTP id k7T6J4Xr031458 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Mon, 28 Aug 2006 23:19:05 -0700 Received: from [10.10.1.2] ([67.170.239.34]) (authenticated bits=0) by smtp.corp.google.com (8.13.7/8.13.6) with ESMTP id k7T6J4kW026313 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Mon, 28 Aug 2006 23:19:04 -0700 Message-ID: <44F3DC2D.1070403@google.com> Date: Mon, 28 Aug 2006 23:18:21 -0700 From: "Martin J. Bligh" User-Agent: Thunderbird 1.5.0.5 (X11/20060728) MIME-Version: 1.0 To: Brandon Philips Cc: autotest@test-kernel.osuosl.org Subject: Re: [Autotest] [PATCH] Move linux-2.6.14.tar.bz2 from /usr/local/src/ to the kernbench directory References: <20060823182722.GE5291@vnet.ibm.com> In-Reply-To: <20060823182722.GE5291@vnet.ibm.com> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.6 tagged_above=-999.0 required=5.0 tests=BAYES_00 X-Spam-Level: X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.6 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: Status: RO Content-Length: 1425 Lines: 42 Brandon Philips wrote: > Move linux-2.6.14.tar.bz2 so luser (like me) can setup kernbench w/o > root. Yup, I suppose that's more consistent with the rest of the tests. It's not packaged in just because it's too damned big. Really, it should fetch it itself and cache it locally. But ... this seems like a reasonable short-term fix. Applied. M. PS. there was an intent to also hook the downloader into the autoexpander, so you can spec things like "2.6.17-rc2-mm1" in the kernel build, and it'd just work. http://ftp.kernel.org/pub/linux/kernel/people/mbligh/tools/kernelexpand But not done yet. > --- > tests/kernbench/kernbench.py | 3 ++- > 1 files changed, 2 insertions(+), 1 deletions(-) > > diff --git a/tests/kernbench/kernbench.py b/tests/kernbench/kernbench.py > index 3800152..6d16fcd 100755 > --- a/tests/kernbench/kernbench.py > +++ b/tests/kernbench/kernbench.py > @@ -5,7 +5,8 @@ class kernbench(test.test): > version = 1 > > def setup(self): > - tarball = '/usr/local/src/linux-2.6.14.tar.bz2' > + # http://kernel.org/pub/linux/kernel/v2.6/linux-2.6.14.tar.bz2 > + tarball = self.bindir + '/linux-2.6.14.tar.bz2' > config = self.bindir + "/config" > kernel = self.job.kernel(self.srcdir, tarball) > kernel.config(config) > _______________________________________________ > Autotest mailing list > Autotest@test.kernel.org > http://test.kernel.org/cgi-bin/mailman/listinfo/autotest From mbligh@google.com Wed Aug 30 08:55:11 2006 Return-Path: X-Original-To: brandon@osuosl.org Delivered-To: philips@osuosl.org Received: from ns2.osuosl.org (ns2.osuosl.org [140.211.166.131]) by shell.osuosl.org (Postfix) with ESMTP id 6636062C0D7 for ; Wed, 30 Aug 2006 08:55:11 -0700 (PDT) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns2.osuosl.org (Postfix) with ESMTP id B1F86123121 for ; Wed, 30 Aug 2006 09:53:55 -0700 (PDT) Received: from ns2.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 22481-60 for ; Wed, 30 Aug 2006 09:53:49 -0700 (PDT) Received: from secure.lairdnovak.com (jackass2.lairdnovak.com [64.34.179.15]) by ns2.osuosl.org (Postfix) with ESMTP id C02E5122FCC for ; Wed, 30 Aug 2006 09:53:28 -0700 (PDT) Received: by secure.lairdnovak.com (Postfix) id 15E12658193; Wed, 30 Aug 2006 15:54:44 +0000 (UTC) Delivered-To: philips@secure.lairdnovak.com Received: from ns1.osuosl.org (ns1.osuosl.org [140.211.166.130]) by secure.lairdnovak.com (Postfix) with ESMTP id E0546658174 for ; Wed, 30 Aug 2006 15:54:43 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns1.osuosl.org (Postfix) with ESMTP id 8170F336A02 for ; Wed, 30 Aug 2006 08:54:43 -0700 (PDT) Received: from ns1.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 11302-67 for ; Wed, 30 Aug 2006 08:54:33 -0700 (PDT) Received: from smtp-out.google.com (smtp-out.google.com [216.239.45.12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ns1.osuosl.org (Postfix) with ESMTP id 69D7C3369F4 for ; Wed, 30 Aug 2006 08:54:13 -0700 (PDT) Received: from zps35.corp.google.com (zps35.corp.google.com [172.25.146.35]) by smtp-out.google.com with ESMTP id k7UFs0xC015369; Wed, 30 Aug 2006 08:54:00 -0700 DomainKey-Signature: a=rsa-sha1; s=beta; d=google.com; c=nofws; q=dns; h=received:message-id:date:from:user-agent:mime-version:to:cc: subject:references:in-reply-to:content-type; b=g2Y2LoKBXK7PgNmEv7wER8IuH03PMb007BSEO6XZhnC9zJo15vrb32tctZKqCvVYf p7R634SUOCGM1xYXQbuMw== Received: from smtp.corp.google.com (baraddur.corp.google.com [192.168.15.228]) by zps35.corp.google.com with ESMTP id k7UFrvcM027576 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Wed, 30 Aug 2006 08:53:57 -0700 Received: from [10.10.1.2] ([67.170.239.34]) (authenticated bits=0) by smtp.corp.google.com (8.13.7/8.13.6) with ESMTP id k7UFruDJ005515 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Wed, 30 Aug 2006 08:53:56 -0700 Message-ID: <44F5B462.5030600@google.com> Date: Wed, 30 Aug 2006 08:53:06 -0700 From: "Martin J. Bligh" User-Agent: Thunderbird 1.5.0.5 (X11/20060728) MIME-Version: 1.0 To: Brandon Philips Cc: autotest@test-kernel.osuosl.org Subject: Re: [Autotest] [PATCH] teach kernbench to use a defconfig to support other platforms References: <20060823201747.GG5291@vnet.ibm.com> In-Reply-To: <20060823201747.GG5291@vnet.ibm.com> Content-Type: multipart/mixed; boundary="------------090406070901060805020405" X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.6 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.6 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: Status: RO Content-Length: 3249 Lines: 97 This is a multi-part message in MIME format. --------------090406070901060805020405 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Brandon Philips wrote: > --- > bin/kernel.py | 7 > tests/kernbench/config | 1441 ------------------------------------------ > tests/kernbench/kernbench.py | 3 > 3 files changed, 8 insertions(+), 1443 deletions(-) > > diff --git a/bin/kernel.py b/bin/kernel.py > index 16d7805..d9d3f06 100755 > --- a/bin/kernel.py > +++ b/bin/kernel.py > @@ -82,6 +82,13 @@ class kernel: > self.job.stdout.restore() > > > + def defconfig(self): > + """make config with defaults > + """ > + os.chdir(self.build_dir) > + system('make defconfig') > + > + > def get_patches(self, patches): > """fetch the patches to the local patch_dir""" > local_patches = [] Sorry. Have been pondering this one a while. I think it's basically the right thing to do; however, what we're really doing here is making a config file, so should this not be part of the kernel_config class (or at least in kernel_config.py). Perhaps if the first arg to kernel.config() (which becomes orig_file in kernel_config.__init__() ) is an empty string, then it should generate defconfig instead? Has a few practical advantages, as well as the cleanliness of placement. We can use the overrides feature easily from defconfig, if that was needed, and the output redirect gets set up properly. Something along the lines of the attached? M. --------------090406070901060805020405 Content-Type: text/x-patch; name="kernbench.diff" Content-Transfer-Encoding: 7bit Content-Disposition: inline; filename="kernbench.diff" Index: tests/kernbench/kernbench.py =================================================================== --- tests/kernbench/kernbench.py (revision 170) +++ tests/kernbench/kernbench.py (working copy) @@ -7,9 +7,8 @@ def setup(self): # http://kernel.org/pub/linux/kernel/v2.6/linux-2.6.14.tar.bz2 tarball = self.bindir + '/linux-2.6.14.tar.bz2' - config = self.bindir + "/config" kernel = self.job.kernel(self.srcdir, tarball) - kernel.config(config) + kernel.config('') # have to save this off, as we might use it in another run kernel.pickle_dump(self.srcdir + '/.pickle') Index: bin/kernel_config.py =================================================================== --- bin/kernel_config.py (revision 165) +++ bin/kernel_config.py (working copy) @@ -59,11 +59,16 @@ # 1. Get original config file self.build_config = build_dir + '/.config' - self.orig_config = config_dir + '/config.orig' - get_file(orig_file, self.orig_config) - self.update_config(self.orig_config, self.orig_config+'.new') - diff_configs(self.orig_config, self.orig_config+'.new') + if (orig_file == ''): # use defconfig + os.chdir(build_dir) + system('make defconfig') + else: + self.orig_config = config_dir + '/config.orig' + get_file(orig_file, self.orig_config) + self.update_config(self.orig_config, self.orig_config+'.new') + diff_configs(self.orig_config, self.orig_config+'.new') + # 2. Apply overrides if overrides: self.over_config = config_dir + '/config.over' --------------090406070901060805020405-- From philips@vnet.ibm.com Wed Aug 30 09:35:33 2006 Return-Path: X-Original-To: brandon@osuosl.org Delivered-To: philips@osuosl.org Received: from ns1.osuosl.org (ns1.osuosl.org [140.211.166.130]) by shell.osuosl.org (Postfix) with ESMTP id E67D262C0D7 for ; Wed, 30 Aug 2006 09:35:33 -0700 (PDT) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns1.osuosl.org (Postfix) with ESMTP id CED6B33698B for ; Wed, 30 Aug 2006 09:35:33 -0700 (PDT) Received: from ns1.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 26735-12 for ; Wed, 30 Aug 2006 09:35:23 -0700 (PDT) Received: from secure.lairdnovak.com (jackass2.lairdnovak.com [64.34.179.15]) by ns1.osuosl.org (Postfix) with ESMTP id DCAA433695F for ; Wed, 30 Aug 2006 09:35:02 -0700 (PDT) Received: by secure.lairdnovak.com (Postfix) id 8BBF765829F; Wed, 30 Aug 2006 16:35:02 +0000 (UTC) Delivered-To: philips@secure.lairdnovak.com Received: from ns1.osuosl.org (ns1.osuosl.org [140.211.166.130]) by secure.lairdnovak.com (Postfix) with ESMTP id 61BCC65829E for ; Wed, 30 Aug 2006 16:35:02 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns1.osuosl.org (Postfix) with ESMTP id EE86B33695F for ; Wed, 30 Aug 2006 09:35:01 -0700 (PDT) Received: from ns1.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 27747-09 for ; Wed, 30 Aug 2006 09:34:52 -0700 (PDT) Received: from e1.ny.us.ibm.com (e1.ny.us.ibm.com [32.97.182.141]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ns1.osuosl.org (Postfix) with ESMTP id E526F336982 for ; Wed, 30 Aug 2006 09:34:31 -0700 (PDT) Received: from d01relay04.pok.ibm.com (d01relay04.pok.ibm.com [9.56.227.236]) by e1.ny.us.ibm.com (8.13.8/8.12.11) with ESMTP id k7UGYR66008703 for ; Wed, 30 Aug 2006 12:34:30 -0400 Received: from d01av01.pok.ibm.com (d01av01.pok.ibm.com [9.56.224.215]) by d01relay04.pok.ibm.com (8.13.6/8.13.6/NCO v8.1.1) with ESMTP id k7UGYRrA198656 for ; Wed, 30 Aug 2006 12:34:27 -0400 Received: from d01av01.pok.ibm.com (loopback [127.0.0.1]) by d01av01.pok.ibm.com (8.12.11.20060308/8.13.3) with ESMTP id k7UGYRft020471 for ; Wed, 30 Aug 2006 12:34:27 -0400 Received: from karen.austin.ibm.com (dyn95340193.austin.ibm.com [9.53.40.193]) by d01av01.pok.ibm.com (8.12.11.20060308/8.12.11) with ESMTP id k7UGYRH1020430; Wed, 30 Aug 2006 12:34:27 -0400 Received: by karen.austin.ibm.com (Postfix, from userid 1000) id 14548280069; Wed, 30 Aug 2006 11:31:31 -0500 (CDT) Date: Wed, 30 Aug 2006 11:31:31 -0500 From: Brandon Philips To: "Martin J. Bligh" Cc: autotest@test-kernel.osuosl.org, Brandon Philips Subject: Re: [Autotest] [PATCH] teach kernbench to use a defconfig to support other platforms Message-ID: <20060830163130.GC17112@vnet.ibm.com> References: <20060823201747.GG5291@vnet.ibm.com> <44F5B462.5030600@google.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <44F5B462.5030600@google.com> User-Agent: Mutt/1.5.13 (2006-08-11) X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.6 tagged_above=-999.0 required=5.0 tests=BAYES_00 X-Spam-Level: X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.6 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: Status: RO Content-Length: 2137 Lines: 61 On 08:53 Wed 30 Aug 2006, Martin J. Bligh wrote: > Sorry. Have been pondering this one a while. I think it's basically > the right thing to do; however, what we're really doing here is > making a config file, so should this not be part of the kernel_config > class (or at least in kernel_config.py). I agree. I like your patch better. > Something along the lines of the attached? Works for me, and the placement is better. For what it is worth: Signed-off-by: Brandon Philips Thanks, Brandon > Index: tests/kernbench/kernbench.py > =================================================================== > --- tests/kernbench/kernbench.py (revision 170) > +++ tests/kernbench/kernbench.py (working copy) > @@ -7,9 +7,8 @@ > def setup(self): > # http://kernel.org/pub/linux/kernel/v2.6/linux-2.6.14.tar.bz2 > tarball = self.bindir + '/linux-2.6.14.tar.bz2' > - config = self.bindir + "/config" > kernel = self.job.kernel(self.srcdir, tarball) > - kernel.config(config) > + kernel.config('') > # have to save this off, as we might use it in another run > kernel.pickle_dump(self.srcdir + '/.pickle') > > Index: bin/kernel_config.py > =================================================================== > --- bin/kernel_config.py (revision 165) > +++ bin/kernel_config.py (working copy) > @@ -59,11 +59,16 @@ > > # 1. Get original config file > self.build_config = build_dir + '/.config' > - self.orig_config = config_dir + '/config.orig' > - get_file(orig_file, self.orig_config) > - self.update_config(self.orig_config, self.orig_config+'.new') > - diff_configs(self.orig_config, self.orig_config+'.new') > + if (orig_file == ''): # use defconfig > + os.chdir(build_dir) > + system('make defconfig') > + else: > + self.orig_config = config_dir + '/config.orig' > + get_file(orig_file, self.orig_config) > + self.update_config(self.orig_config, self.orig_config+'.new') > + diff_configs(self.orig_config, self.orig_config+'.new') > > + added white space intended? > # 2. Apply overrides > if overrides: > self.over_config = config_dir + '/config.over' From rdunlap@xenotime.net Wed Aug 30 09:41:24 2006 Return-Path: X-Original-To: brandon@osuosl.org Delivered-To: philips@osuosl.org Received: from ns2.osuosl.org (ns2.osuosl.org [140.211.166.131]) by shell.osuosl.org (Postfix) with ESMTP id EED3062C0D7 for ; Wed, 30 Aug 2006 09:41:24 -0700 (PDT) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns2.osuosl.org (Postfix) with ESMTP id 3FB30122C82 for ; Wed, 30 Aug 2006 10:40:09 -0700 (PDT) Received: from ns2.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 05058-05 for ; Wed, 30 Aug 2006 10:40:03 -0700 (PDT) Received: from secure.lairdnovak.com (jackass2.lairdnovak.com [64.34.179.15]) by ns2.osuosl.org (Postfix) with ESMTP id EFD1012216C for ; Wed, 30 Aug 2006 10:39:42 -0700 (PDT) Received: by secure.lairdnovak.com (Postfix) id 4FB9B65829F; Wed, 30 Aug 2006 16:40:58 +0000 (UTC) Delivered-To: philips@secure.lairdnovak.com Received: from ns2.osuosl.org (ns2.osuosl.org [140.211.166.131]) by secure.lairdnovak.com (Postfix) with ESMTP id 3963265829E for ; Wed, 30 Aug 2006 16:40:58 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns2.osuosl.org (Postfix) with ESMTP id 0B747122DA8 for ; Wed, 30 Aug 2006 10:39:42 -0700 (PDT) Received: from ns2.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 23114-65 for ; Wed, 30 Aug 2006 10:39:40 -0700 (PDT) Received: from xenotime.net (xenotime.net [66.160.160.81]) by ns2.osuosl.org (Postfix) with SMTP id 1D2E2122D9D for ; Wed, 30 Aug 2006 10:39:19 -0700 (PDT) Received: from midway.site ([71.117.233.155]) by xenotime.net for ; Wed, 30 Aug 2006 09:40:33 -0700 Date: Wed, 30 Aug 2006 09:43:58 -0700 From: "Randy.Dunlap" To: Brandon Philips Cc: "Martin J. Bligh" , autotest@test-kernel.osuosl.org Subject: Re: [Autotest] [PATCH] teach kernbench to use a defconfig to support other platforms Message-Id: <20060830094358.4dafe0cf.rdunlap@xenotime.net> In-Reply-To: <20060830163130.GC17112@vnet.ibm.com> References: <20060823201747.GG5291@vnet.ibm.com> <44F5B462.5030600@google.com> <20060830163130.GC17112@vnet.ibm.com> Organization: YPO4 X-Mailer: Sylpheed version 2.2.7 (GTK+ 2.8.10; x86_64-unknown-linux-gnu) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.6 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.6 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: Status: RO Content-Length: 675 Lines: 21 On Wed, 30 Aug 2006 11:31:31 -0500 Brandon Philips wrote: > On 08:53 Wed 30 Aug 2006, Martin J. Bligh wrote: > > Sorry. Have been pondering this one a while. I think it's basically > > the right thing to do; however, what we're really doing here is > > making a config file, so should this not be part of the kernel_config > > class (or at least in kernel_config.py). > > I agree. I like your patch better. > > > Something along the lines of the attached? > > Works for me, and the placement is better. For what it is worth: > > Signed-off-by: Brandon Philips Martin, In general, do you want/need S-O-B lines like kernel/sparse/git do? --- ~Randy From dustin.kirkland@us.ibm.com Wed Aug 30 09:47:41 2006 Return-Path: X-Original-To: brandon@osuosl.org Delivered-To: philips@osuosl.org Received: from ns1.osuosl.org (ns1.osuosl.org [140.211.166.130]) by shell.osuosl.org (Postfix) with ESMTP id 4F5DD62C0D7 for ; Wed, 30 Aug 2006 09:47:41 -0700 (PDT) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns1.osuosl.org (Postfix) with ESMTP id 33CA6336982 for ; Wed, 30 Aug 2006 09:47:41 -0700 (PDT) Received: from ns1.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 16743-64 for ; Wed, 30 Aug 2006 09:47:34 -0700 (PDT) Received: from secure.lairdnovak.com (jackass2.lairdnovak.com [64.34.179.15]) by ns1.osuosl.org (Postfix) with ESMTP id A7C0433698D for ; Wed, 30 Aug 2006 09:47:14 -0700 (PDT) Received: by secure.lairdnovak.com (Postfix) id 5905865829F; Wed, 30 Aug 2006 16:47:14 +0000 (UTC) Delivered-To: philips@secure.lairdnovak.com Received: from ns2.osuosl.org (ns2.osuosl.org [140.211.166.131]) by secure.lairdnovak.com (Postfix) with ESMTP id 3C91F65829B for ; Wed, 30 Aug 2006 16:47:14 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns2.osuosl.org (Postfix) with ESMTP id 154DE123388 for ; Wed, 30 Aug 2006 10:45:58 -0700 (PDT) Received: from ns2.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 05058-07 for ; Wed, 30 Aug 2006 10:45:51 -0700 (PDT) Received: from e2.ny.us.ibm.com (e2.ny.us.ibm.com [32.97.182.142]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ns2.osuosl.org (Postfix) with ESMTP id 6AADA122DD5 for ; Wed, 30 Aug 2006 10:45:31 -0700 (PDT) Received: from d01relay02.pok.ibm.com (d01relay02.pok.ibm.com [9.56.227.234]) by e2.ny.us.ibm.com (8.13.8/8.12.11) with ESMTP id k7UGkjwr012310 for ; Wed, 30 Aug 2006 12:46:45 -0400 Received: from d01av04.pok.ibm.com (d01av04.pok.ibm.com [9.56.224.64]) by d01relay02.pok.ibm.com (8.13.6/8.13.6/NCO v8.1.1) with ESMTP id k7UGkj4m284834 for ; Wed, 30 Aug 2006 12:46:45 -0400 Received: from d01av04.pok.ibm.com (loopback [127.0.0.1]) by d01av04.pok.ibm.com (8.12.11.20060308/8.13.3) with ESMTP id k7UGkjbG022867 for ; Wed, 30 Aug 2006 12:46:45 -0400 Received: from sig-9-65-140-50.mts.ibm.com (sig-9-65-140-50.mts.ibm.com [9.65.140.50]) by d01av04.pok.ibm.com (8.12.11.20060308/8.12.11) with ESMTP id k7UGki1B022793; Wed, 30 Aug 2006 12:46:45 -0400 Subject: Re: [Autotest] [PATCH] teach kernbench to use a defconfig to support other platforms From: Dustin Kirkland Reply-To: Dustin Kirkland To: "Randy.Dunlap" Cc: Brandon Philips , autotest@test-kernel.osuosl.org In-Reply-To: <20060830094358.4dafe0cf.rdunlap@xenotime.net> References: <20060823201747.GG5291@vnet.ibm.com> <44F5B462.5030600@google.com> <20060830163130.GC17112@vnet.ibm.com> <20060830094358.4dafe0cf.rdunlap@xenotime.net> Content-Type: text/plain Organization: IBM Date: Wed, 30 Aug 2006 11:46:43 -0500 Message-Id: <1156956403.3777.64.camel@localhost.localdomain> Mime-Version: 1.0 X-Mailer: Evolution 2.2.3 (2.2.3-4.fc4) Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.6 tagged_above=-999.0 required=5.0 tests=BAYES_00 X-Spam-Level: X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.6 tagged_above=-999.0 required=5.0 tests=BAYES_00 X-Spam-Level: Status: RO Content-Length: 292 Lines: 19 On Wed, 2006-08-30 at 09:43 -0700, Randy.Dunlap wrote: > In general, do you want/need S-O-B lines like kernel/sparse/git do? If we were to put this to a vote, I'm a fan of: [One-line patch title] [Multi-line patch description] [Signed off by line] [patch] My two cents ;-) :-Dustin From mbligh@google.com Wed Aug 30 09:58:47 2006 Return-Path: X-Original-To: brandon@osuosl.org Delivered-To: philips@osuosl.org Received: from ns1.osuosl.org (ns1.osuosl.org [140.211.166.130]) by shell.osuosl.org (Postfix) with ESMTP id 684E262C0D7 for ; Wed, 30 Aug 2006 09:58:47 -0700 (PDT) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns1.osuosl.org (Postfix) with ESMTP id 49BFE33697A for ; Wed, 30 Aug 2006 09:58:47 -0700 (PDT) Received: from ns1.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 17987-56 for ; Wed, 30 Aug 2006 09:58:45 -0700 (PDT) Received: from secure.lairdnovak.com (jackass2.lairdnovak.com [64.34.179.15]) by ns1.osuosl.org (Postfix) with ESMTP id 0699933698D for ; Wed, 30 Aug 2006 09:58:25 -0700 (PDT) Received: by secure.lairdnovak.com (Postfix) id BE66965829F; Wed, 30 Aug 2006 16:58:24 +0000 (UTC) Delivered-To: philips@secure.lairdnovak.com Received: from ns2.osuosl.org (ns2.osuosl.org [140.211.166.131]) by secure.lairdnovak.com (Postfix) with ESMTP id 8A92E658195 for ; Wed, 30 Aug 2006 16:58:24 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns2.osuosl.org (Postfix) with ESMTP id 810E2122F9A for ; Wed, 30 Aug 2006 10:57:08 -0700 (PDT) Received: from ns2.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 24633-64-3 for ; Wed, 30 Aug 2006 10:57:06 -0700 (PDT) Received: from smtp-out.google.com (smtp-out.google.com [216.239.45.12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ns2.osuosl.org (Postfix) with ESMTP id 8F3AB1226B5 for ; Wed, 30 Aug 2006 10:56:46 -0700 (PDT) Received: from zps78.corp.google.com (zps78.corp.google.com [172.25.146.78]) by smtp-out.google.com with ESMTP id k7UGvgWm006517; Wed, 30 Aug 2006 09:57:42 -0700 DomainKey-Signature: a=rsa-sha1; s=beta; d=google.com; c=nofws; q=dns; h=received:message-id:date:from:user-agent: x-accept-language:mime-version:to:cc:subject:references:in-reply-to: content-type:content-transfer-encoding; b=CZM3S7gKMZdfk8lIY6Ct2GHCwBoOGjvBXDhZeVPp7h+AGgUuHuD3xCkpmQIjvSGuG lv/X0yMaZ7pepmAgUGfkQ== Received: from [172.18.108.59] (mbligh.corp.google.com [172.18.108.59]) by zps78.corp.google.com with ESMTP id k7UGvcXc023840; Wed, 30 Aug 2006 09:57:38 -0700 Message-ID: <44F5C382.3060006@google.com> Date: Wed, 30 Aug 2006 09:57:38 -0700 From: Martin Bligh User-Agent: Mozilla Thunderbird 1.0.7 (X11/20051011) X-Accept-Language: en-us, en MIME-Version: 1.0 To: Dustin Kirkland Cc: "Randy.Dunlap" , autotest@test-kernel.osuosl.org, Brandon Philips Subject: Re: [Autotest] [PATCH] teach kernbench to use a defconfig to support other platforms References: <20060823201747.GG5291@vnet.ibm.com> <44F5B462.5030600@google.com> <20060830163130.GC17112@vnet.ibm.com> <20060830094358.4dafe0cf.rdunlap@xenotime.net> <1156956403.3777.64.camel@localhost.localdomain> In-Reply-To: <1156956403.3777.64.camel@localhost.localdomain> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.4 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.5 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: Status: RO Content-Length: 1920 Lines: 57 Dustin Kirkland wrote: > On Wed, 2006-08-30 at 09:43 -0700, Randy.Dunlap wrote: > >>In general, do you want/need S-O-B lines like kernel/sparse/git do? > > > If we were to put this to a vote, I'm a fan of: > > [One-line patch title] > > [Multi-line patch description] > > [Signed off by line] > > [patch] > > > My two cents ;-) Sounds about right. For trivial stuff, I'm not super-fussed, but as a general rule, it's good to have the documented trail. Note this is for the DCO, which says: -------------------------- By making a contribution to this project, I certify that: (a) The contribution was created in whole or in part by me and I have the right to submit it under the open source license indicated in the file; or (b) The contribution is based upon previous work that, to the best of my knowledge, is covered under an appropriate open source license and I have the right under that license to submit that work with modifications, whether created in whole or in part by me, under the same open source license (unless I am permitted to submit under a different license), as indicated in the file; or (c) The contribution was provided directly to me by some other person who certified (a), (b) or (c) and I have not modified it; and (d) In the case of each of (a), (b), or (c), I understand and agree that this project and the contribution are public and that a record of the contribution (including all personal information I submit with it, including my sign-off) is maintained indefinitely and may be redistributed consistent with this project or the open source license indicated in the file. ------------------------------- So it's for specifying that you actually wrote the code in question. Given the nature of the beast, is kind of hard to steal things like test wrappers from somewhere else, as they're very specific to the project, but it's a good habit to get into. M. From apw@shadowen.org Wed Aug 30 12:46:35 2006 Return-Path: X-Original-To: brandon@osuosl.org Delivered-To: philips@osuosl.org Received: from ns2.osuosl.org (ns2.osuosl.org [140.211.166.131]) by shell.osuosl.org (Postfix) with ESMTP id 29B9F62C0D7 for ; Wed, 30 Aug 2006 12:46:35 -0700 (PDT) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns2.osuosl.org (Postfix) with ESMTP id 6F6191232EC for ; Wed, 30 Aug 2006 13:45:19 -0700 (PDT) Received: from ns2.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 13398-49 for ; Wed, 30 Aug 2006 13:45:18 -0700 (PDT) Received: from secure.lairdnovak.com (jackass2.lairdnovak.com [64.34.179.15]) by ns2.osuosl.org (Postfix) with ESMTP id D55701232AD for ; Wed, 30 Aug 2006 13:45:17 -0700 (PDT) Received: by secure.lairdnovak.com (Postfix) id 311906582A1; Wed, 30 Aug 2006 19:46:33 +0000 (UTC) Delivered-To: philips@secure.lairdnovak.com Received: from ns2.osuosl.org (ns2.osuosl.org [140.211.166.131]) by secure.lairdnovak.com (Postfix) with ESMTP id E789265829C for ; Wed, 30 Aug 2006 19:46:32 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns2.osuosl.org (Postfix) with ESMTP id CA5DA1232EB for ; Wed, 30 Aug 2006 13:45:16 -0700 (PDT) Received: from ns2.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 10793-73 for ; Wed, 30 Aug 2006 13:45:10 -0700 (PDT) Received: from hellhawk.shadowen.org (hellhawk.shadowen.org [80.68.90.175]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (No client certificate requested) by ns2.osuosl.org (Postfix) with ESMTP id 30F891232DD for ; Wed, 30 Aug 2006 13:45:09 -0700 (PDT) Received: from localhost ([127.0.0.1]) by hellhawk.shadowen.org with esmtp (Exim 4.50) id 1GIW0f-0006Vg-CE; Wed, 30 Aug 2006 20:46:01 +0100 Message-ID: <44F5EB01.6040101@shadowen.org> Date: Wed, 30 Aug 2006 20:46:09 +0100 From: Andy Whitcroft User-Agent: Thunderbird 1.5.0.4 (X11/20060713) MIME-Version: 1.0 To: Brandon Philips Cc: autotest@test-kernel.osuosl.org Subject: Re: [Autotest] [PATCH] Add the -t flag to autotest to tag the run of a job References: <20060829220805.GA17112@vnet.ibm.com> In-Reply-To: <20060829220805.GA17112@vnet.ibm.com> X-Enigmail-Version: 0.94.0.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.5 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.5 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: Status: RO Content-Length: 677 Lines: 19 Brandon Philips wrote: > - When the -t option is used the results of a control file run are put in > /results/ > > - Use optparse for parsing the autotest parameters > > Note: I haven't tested the continue parameter since I don't know how to > use it. There are some tests in the self test suite that rely on the --continue working as expected. The main idea is if you are doing something that might require a reboot you would effectivly complete the test run, but leave enough state to continue. The harness which runs the job would then continue the job in progress using --continue. In the simplest form this would be an S99autotest init script. -apw From mbligh@google.com Wed Sep 13 09:08:24 2006 Return-Path: X-Original-To: brandon@osuosl.org Delivered-To: philips@osuosl.org Received: from ns1.osuosl.org (ns1.osuosl.org [140.211.166.130]) by shell.osuosl.org (Postfix) with ESMTP id 5B5222F4025 for ; Wed, 13 Sep 2006 09:08:24 -0700 (PDT) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns1.osuosl.org (Postfix) with ESMTP id 3D37B336799 for ; Wed, 13 Sep 2006 09:08:24 -0700 (PDT) Received: from ns1.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 15948-08 for ; Wed, 13 Sep 2006 09:08:23 -0700 (PDT) Received: from secure.lairdnovak.com (jackass2.lairdnovak.com [64.34.179.15]) by ns1.osuosl.org (Postfix) with ESMTP id DCF6C33670E for ; Wed, 13 Sep 2006 09:08:22 -0700 (PDT) Received: by secure.lairdnovak.com (Postfix) id 74D556582B1; Wed, 13 Sep 2006 16:08:22 +0000 (UTC) Delivered-To: philips@secure.lairdnovak.com Received: from ns1.osuosl.org (ns1.osuosl.org [140.211.166.130]) by secure.lairdnovak.com (Postfix) with ESMTP id 4E51E658299 for ; Wed, 13 Sep 2006 16:08:22 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns1.osuosl.org (Postfix) with ESMTP id CD4053369D7 for ; Wed, 13 Sep 2006 09:08:21 -0700 (PDT) Received: from ns1.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 15351-15 for ; Wed, 13 Sep 2006 09:08:15 -0700 (PDT) Received: from smtp-out.google.com (smtp-out.google.com [216.239.45.12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ns1.osuosl.org (Postfix) with ESMTP id 93B3A336A5F for ; Wed, 13 Sep 2006 09:08:14 -0700 (PDT) Received: from zps37.corp.google.com (zps37.corp.google.com [172.25.146.37]) by smtp-out.google.com with ESMTP id k8DG8BH3022009; Wed, 13 Sep 2006 09:08:11 -0700 DomainKey-Signature: a=rsa-sha1; s=beta; d=google.com; c=nofws; q=dns; h=received:message-id:date:from:user-agent: x-accept-language:mime-version:to:cc:subject:references:in-reply-to: content-type:content-transfer-encoding; b=ilsHg8RqKMZscYKWe42SEDFBFM+80pGDP6AJCYHlb4Lla6Ub1+P1MKTDwi5ufQXbs rZSSIA5jHzWW2/S8i5G0w== Received: from [172.18.108.59] (mbligh.corp.google.com [172.18.108.59]) by zps37.corp.google.com with ESMTP id k8DG87rx015506; Wed, 13 Sep 2006 09:08:07 -0700 Message-ID: <45082CE7.8040505@google.com> Date: Wed, 13 Sep 2006 09:08:07 -0700 From: Martin Bligh User-Agent: Mozilla Thunderbird 1.0.7 (X11/20051011) X-Accept-Language: en-us, en MIME-Version: 1.0 To: Brandon Philips Cc: autotest@test-kernel.osuosl.org Subject: Re: [Autotest] [PATCH] Add the -t flag to autotest to tag the run of a job References: <20060829220805.GA17112@vnet.ibm.com> In-Reply-To: <20060829220805.GA17112@vnet.ibm.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-1.2 tagged_above=-999.0 required=5.0 tests=AWL X-Spam-Level: X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.5 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: Status: RO Content-Length: 336 Lines: 13 Brandon Philips wrote: > - When the -t option is used the results of a control file run are put in > /results/ > > - Use optparse for parsing the autotest parameters > > Note: I haven't tested the continue parameter since I don't know how to > use it. > > Signed-off-by: Brandon Philips Applied. From mbligh@google.com Thu Aug 31 08:21:37 2006 Return-Path: X-Original-To: brandon@osuosl.org Delivered-To: philips@osuosl.org Received: from ns2.osuosl.org (ns2.osuosl.org [140.211.166.131]) by shell.osuosl.org (Postfix) with ESMTP id 2C94062C0D7 for ; Thu, 31 Aug 2006 08:21:37 -0700 (PDT) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns2.osuosl.org (Postfix) with ESMTP id 68CB1123522 for ; Thu, 31 Aug 2006 09:20:21 -0700 (PDT) Received: from ns2.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 05902-75 for ; Thu, 31 Aug 2006 09:20:15 -0700 (PDT) Received: from secure.lairdnovak.com (jackass2.lairdnovak.com [64.34.179.15]) by ns2.osuosl.org (Postfix) with ESMTP id E997F12352B for ; Thu, 31 Aug 2006 09:20:14 -0700 (PDT) Received: by secure.lairdnovak.com (Postfix) id 686EF65829E; Thu, 31 Aug 2006 15:21:30 +0000 (UTC) Delivered-To: philips@secure.lairdnovak.com Received: from ns1.osuosl.org (ns1.osuosl.org [140.211.166.130]) by secure.lairdnovak.com (Postfix) with ESMTP id 4E77265829D for ; Thu, 31 Aug 2006 15:21:30 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns1.osuosl.org (Postfix) with ESMTP id 04360336A23 for ; Thu, 31 Aug 2006 07:50:17 -0700 (PDT) Received: from ns1.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 10731-65 for ; Thu, 31 Aug 2006 07:49:59 -0700 (PDT) Received: from smtp-out.google.com (smtp-out.google.com [216.239.45.12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ns1.osuosl.org (Postfix) with ESMTP id D3CE5336AC4 for ; Thu, 31 Aug 2006 07:49:59 -0700 (PDT) Received: from zps38.corp.google.com (zps38.corp.google.com [172.25.146.38]) by smtp-out.google.com with ESMTP id k7VEnOZo032414; Thu, 31 Aug 2006 07:49:29 -0700 DomainKey-Signature: a=rsa-sha1; s=beta; d=google.com; c=nofws; q=dns; h=received:message-id:date:from:user-agent:mime-version:to:cc: subject:references:in-reply-to:content-type:content-transfer-encoding; b=rc1uvshwSj0mVYlFu0POiRN9rj36ORdaVgA02wSlafMRpRXHpb9uFMlL9oHAWLn/w gaUDj+mNpfDdLZpa/Pqlg== Received: from smtp.corp.google.com (mordor.corp.google.com [192.168.15.226]) by zps38.corp.google.com with ESMTP id k7VEnMsD020439 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Thu, 31 Aug 2006 07:49:22 -0700 Received: from [10.10.1.2] ([67.170.239.34]) (authenticated bits=0) by smtp.corp.google.com (8.13.7/8.13.7) with ESMTP id k7VEnLdo029566 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Thu, 31 Aug 2006 07:49:22 -0700 Message-ID: <44F6F6BA.5050001@google.com> Date: Thu, 31 Aug 2006 07:48:26 -0700 From: "Martin J. Bligh" User-Agent: Thunderbird 1.5.0.5 (X11/20060728) MIME-Version: 1.0 To: Brandon Philips Cc: Yi Yang , autotest@test-kernel.osuosl.org Subject: Re: [Autotest] [PATCH]: Add stress test case References: <44F59F58.4050204@gmail.com> <20060830144126.GB17112@vnet.ibm.com> In-Reply-To: <20060830144126.GB17112@vnet.ibm.com> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.6 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.6 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: Status: RO Content-Length: 561 Lines: 26 Brandon Philips wrote: > On 22:23 Wed 30 Aug 2006, Yi Yang wrote: >> This patch adds stress test case, please review. > > Thanks! > >> + def execute(self, iterations = 1, args_list = ''): >> + if len(args_list) != 0: >> + args = '' + args_list >> + else: >> + args = '-c 4 -t 50 -v' > > Why not simply: > > def execute(self, iterations = 1, args = '-c 4 -t 50 -v'): > > I think that accomplishes the same thing. Agreed. Changed. > Also, would it be best to use count_cpus() for figuring out the -c > parameter? Not sure what this does - Yi ? M. From yang.y.yi@gmail.com Thu Aug 31 08:30:38 2006 Return-Path: X-Original-To: brandon@osuosl.org Delivered-To: philips@osuosl.org Received: from ns1.osuosl.org (ns1.osuosl.org [140.211.166.130]) by shell.osuosl.org (Postfix) with ESMTP id 4764662C0D7 for ; Thu, 31 Aug 2006 08:30:38 -0700 (PDT) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns1.osuosl.org (Postfix) with ESMTP id 840F3336A23 for ; Thu, 31 Aug 2006 08:30:38 -0700 (PDT) Received: from ns1.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 24859-20-2 for ; Thu, 31 Aug 2006 08:30:36 -0700 (PDT) Received: from secure.lairdnovak.com (jackass2.lairdnovak.com [64.34.179.15]) by ns1.osuosl.org (Postfix) with ESMTP id B730E33678B for ; Thu, 31 Aug 2006 08:30:36 -0700 (PDT) Received: by secure.lairdnovak.com (Postfix) id 7851965829F; Thu, 31 Aug 2006 15:30:36 +0000 (UTC) Delivered-To: philips@secure.lairdnovak.com Received: from ns2.osuosl.org (ns2.osuosl.org [140.211.166.131]) by secure.lairdnovak.com (Postfix) with ESMTP id 5EAC5658299 for ; Thu, 31 Aug 2006 15:30:36 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns2.osuosl.org (Postfix) with ESMTP id 532311231E9 for ; Thu, 31 Aug 2006 09:29:20 -0700 (PDT) Received: from ns2.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 10514-44 for ; Thu, 31 Aug 2006 09:29:18 -0700 (PDT) Received: from py-out-1112.google.com (py-out-1112.google.com [64.233.166.178]) by ns2.osuosl.org (Postfix) with ESMTP id 2861E12317B for ; Thu, 31 Aug 2006 09:29:18 -0700 (PDT) Received: by py-out-1112.google.com with SMTP id f25so707746pyf for ; Thu, 31 Aug 2006 08:30:33 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:user-agent:mime-version:to:cc:subject:references:in-reply-to:content-type:content-transfer-encoding; b=ezMcNrRUBj8ZO3ji9ZObuiwJUHbVGelNCdrv9v9gThANCp5OrJW5QhYw7YIUMzAiL1y8mWibgmMMyzmhMUMnS0/MDW6fppT1GuE59NebkkdraASnRDDZ+MfWs+enAiew2S0nkjZjwp5FuaRSvGwGUylGcRhXvT//pmMHJe2Iqnk= Received: by 10.35.98.6 with SMTP id a6mr918301pym; Thu, 31 Aug 2006 08:30:32 -0700 (PDT) Received: from ?61.49.192.115? ( [61.49.192.115]) by mx.gmail.com with ESMTP id w54sm925185pye.2006.08.31.08.30.30; Thu, 31 Aug 2006 08:30:32 -0700 (PDT) Message-ID: <44F7009E.1090106@gmail.com> Date: Thu, 31 Aug 2006 23:30:38 +0800 From: Yi Yang User-Agent: Thunderbird 1.5 (X11/20051201) MIME-Version: 1.0 To: "Martin J. Bligh" Cc: Brandon Philips , autotest@test-kernel.osuosl.org Subject: Re: [Autotest] [PATCH]: Add stress test case References: <44F59F58.4050204@gmail.com> <20060830144126.GB17112@vnet.ibm.com> <44F6F6BA.5050001@google.com> In-Reply-To: <44F6F6BA.5050001@google.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.5 tagged_above=-999.0 required=5.0 tests=BAYES_00, RCVD_BY_IP X-Spam-Level: X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.5 tagged_above=-999.0 required=5.0 tests=BAYES_00, RCVD_BY_IP X-Spam-Level: Status: RO Content-Length: 693 Lines: 30 Martin J. Bligh 写道: > Brandon Philips wrote: >> On 22:23 Wed 30 Aug 2006, Yi Yang wrote: >>> This patch adds stress test case, please review. >> >> Thanks! >> >>> + def execute(self, iterations = 1, args_list = ''): >>> + if len(args_list) != 0: >>> + args = '' + args_list >>> + else: >>> + args = '-c 4 -t 50 -v' >> >> Why not simply: >> def execute(self, iterations = 1, args = '-c 4 -t 50 -v'): >> >> I think that accomplishes the same thing. > > Agreed. Changed. > >> Also, would it be best to use count_cpus() for figuring out the -c >> parameter? > > Not sure what this does - Yi ? -c just means the number of spawned processes ,so it isn't related to the numder of CPU. > > M. > From mbligh@google.com Thu Aug 31 08:34:13 2006 Return-Path: X-Original-To: brandon@osuosl.org Delivered-To: philips@osuosl.org Received: from ns2.osuosl.org (ns2.osuosl.org [140.211.166.131]) by shell.osuosl.org (Postfix) with ESMTP id 2AE6062C0D7 for ; Thu, 31 Aug 2006 08:34:13 -0700 (PDT) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns2.osuosl.org (Postfix) with ESMTP id 6546E1231B1 for ; Thu, 31 Aug 2006 09:32:57 -0700 (PDT) Received: from ns2.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 11080-67-2 for ; Thu, 31 Aug 2006 09:32:49 -0700 (PDT) Received: from secure.lairdnovak.com (jackass2.lairdnovak.com [64.34.179.15]) by ns2.osuosl.org (Postfix) with ESMTP id 3EF98123223 for ; Thu, 31 Aug 2006 09:32:49 -0700 (PDT) Received: by secure.lairdnovak.com (Postfix) id 84ED765829D; Thu, 31 Aug 2006 15:34:04 +0000 (UTC) Delivered-To: philips@secure.lairdnovak.com Received: from ns1.osuosl.org (ns1.osuosl.org [140.211.166.130]) by secure.lairdnovak.com (Postfix) with ESMTP id 6A76A658195 for ; Thu, 31 Aug 2006 15:34:04 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns1.osuosl.org (Postfix) with ESMTP id 02ADD33674C for ; Thu, 31 Aug 2006 08:34:04 -0700 (PDT) Received: from ns1.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 23760-20 for ; Thu, 31 Aug 2006 08:33:54 -0700 (PDT) Received: from smtp-out.google.com (smtp-out.google.com [216.239.45.12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ns1.osuosl.org (Postfix) with ESMTP id 4C973336771 for ; Thu, 31 Aug 2006 08:33:54 -0700 (PDT) Received: from zps38.corp.google.com (zps38.corp.google.com [172.25.146.38]) by smtp-out.google.com with ESMTP id k7VFXkeQ018016; Thu, 31 Aug 2006 08:33:46 -0700 DomainKey-Signature: a=rsa-sha1; s=beta; d=google.com; c=nofws; q=dns; h=received:message-id:date:from:user-agent:mime-version:to:cc: subject:references:in-reply-to:content-type:content-transfer-encoding; b=sX7GddSvkqcJGaIyK/3YWmM2ieAvOcIbNx4R/St3uTmVEqOfH55eQ5CjfxXHGzHHQ KY7pEIlHtxhcCrmYY/BqA== Received: from smtp.corp.google.com (mordor.corp.google.com [192.168.15.226]) by zps38.corp.google.com with ESMTP id k7VFXcxN014704 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Thu, 31 Aug 2006 08:33:39 -0700 Received: from [10.10.1.2] ([67.170.239.34]) (authenticated bits=0) by smtp.corp.google.com (8.13.7/8.13.7) with ESMTP id k7VFXcNV024520 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Thu, 31 Aug 2006 08:33:38 -0700 Message-ID: <44F7011B.2070900@google.com> Date: Thu, 31 Aug 2006 08:32:43 -0700 From: "Martin J. Bligh" User-Agent: Thunderbird 1.5.0.5 (X11/20060728) MIME-Version: 1.0 To: Yi Yang Cc: Brandon Philips , autotest@test-kernel.osuosl.org Subject: Re: [Autotest] [PATCH]: Add stress test case References: <44F59F58.4050204@gmail.com> <20060830144126.GB17112@vnet.ibm.com> <44F6F6BA.5050001@google.com> <44F7009E.1090106@gmail.com> In-Reply-To: <44F7009E.1090106@gmail.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.6 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.6 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: Status: RO Content-Length: 547 Lines: 16 >>> Also, would it be best to use count_cpus() for figuring out the -c >>> parameter? >> >> Not sure what this does - Yi ? > -c just means the number of spawned processes ,so it isn't related to > the numder of CPU. OK, but do we want the number of processes we use to scale with the size of the system? Ie to do a stress test on a 16 CPU system, do we want more processes than on a 1 CPU system? We could do 2x or 4x the number of cpus if you like? Or should it be static, and always the same number regardless of the size of the system? M. From yang.y.yi@gmail.com Thu Aug 31 08:41:53 2006 Return-Path: X-Original-To: brandon@osuosl.org Delivered-To: philips@osuosl.org Received: from ns2.osuosl.org (ns2.osuosl.org [140.211.166.131]) by shell.osuosl.org (Postfix) with ESMTP id 0E9EF62C0D7 for ; Thu, 31 Aug 2006 08:41:53 -0700 (PDT) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns2.osuosl.org (Postfix) with ESMTP id 47FC5121F6E for ; Thu, 31 Aug 2006 09:40:37 -0700 (PDT) Received: from ns2.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 20467-08-2 for ; Thu, 31 Aug 2006 09:40:37 -0700 (PDT) Received: from secure.lairdnovak.com (jackass2.lairdnovak.com [64.34.179.15]) by ns2.osuosl.org (Postfix) with ESMTP id 13292121F85 for ; Thu, 31 Aug 2006 09:40:37 -0700 (PDT) Received: by secure.lairdnovak.com (Postfix) id 6838D658299; Thu, 31 Aug 2006 15:41:52 +0000 (UTC) Delivered-To: philips@secure.lairdnovak.com Received: from ns2.osuosl.org (ns2.osuosl.org [140.211.166.131]) by secure.lairdnovak.com (Postfix) with ESMTP id 4A014658195 for ; Thu, 31 Aug 2006 15:41:52 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns2.osuosl.org (Postfix) with ESMTP id 4AD3B121F6E for ; Thu, 31 Aug 2006 09:40:36 -0700 (PDT) Received: from ns2.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 20467-08 for ; Thu, 31 Aug 2006 09:40:25 -0700 (PDT) Received: from wr-out-0506.google.com (wr-out-0506.google.com [64.233.184.239]) by ns2.osuosl.org (Postfix) with ESMTP id DDF4512206A for ; Thu, 31 Aug 2006 09:40:20 -0700 (PDT) Received: by wr-out-0506.google.com with SMTP id 68so235207wri for ; Thu, 31 Aug 2006 08:41:35 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:user-agent:mime-version:to:cc:subject:references:in-reply-to:content-type:content-transfer-encoding; b=qQy2iCZuxuZjIWaV1LGVTaYzi+9NcLIkgo23lrobLbah5SllmldiziiA14fibDBhAAODYuLVAMdc2UdMVt/u0B5hbftOkgs6BnuktyH/F/CDLt3AeEsAJhWEMawPU+ui2SpyIZ5ILVQcKF33oliP7bNhNkClc4YKIq5uSYYLRQs= Received: by 10.35.29.6 with SMTP id g6mr944001pyj; Thu, 31 Aug 2006 08:41:35 -0700 (PDT) Received: from ?61.49.192.115? ( [61.49.192.115]) by mx.gmail.com with ESMTP id z52sm753127pyg.2006.08.31.08.41.33; Thu, 31 Aug 2006 08:41:35 -0700 (PDT) Message-ID: <44F70337.6080204@gmail.com> Date: Thu, 31 Aug 2006 23:41:43 +0800 From: Yi Yang User-Agent: Thunderbird 1.5 (X11/20051201) MIME-Version: 1.0 To: "Martin J. Bligh" Cc: Brandon Philips , autotest@test-kernel.osuosl.org Subject: Re: [Autotest] [PATCH]: Add stress test case References: <44F59F58.4050204@gmail.com> <20060830144126.GB17112@vnet.ibm.com> <44F6F6BA.5050001@google.com> <44F7009E.1090106@gmail.com> <44F7011B.2070900@google.com> In-Reply-To: <44F7011B.2070900@google.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.5 tagged_above=-999.0 required=5.0 tests=BAYES_00, RCVD_BY_IP X-Spam-Level: X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.5 tagged_above=-999.0 required=5.0 tests=BAYES_00, RCVD_BY_IP X-Spam-Level: Status: RO Content-Length: 784 Lines: 21 Martin J. Bligh 写道: >>>> Also, would it be best to use count_cpus() for figuring out the -c >>>> parameter? >>> >>> Not sure what this does - Yi ? >> -c just means the number of spawned processes ,so it isn't related to >> the numder of CPU. > > > OK, but do we want the number of processes we use to scale with the size > of the system? Ie to do a stress test on a 16 CPU system, do we want > more processes than on a 1 CPU system? > > We could do 2x or 4x the number of cpus if you like? Or should it be > static, and always the same number regardless of the size of the system? Of course, I have considered all the arguments as a argument, you can provide any options at will, for example, job.runtest(None, 'stress', "-c NNN"), so it has been very changeable now. > > M. > From mbligh@google.com Wed Sep 13 09:39:44 2006 Return-Path: X-Original-To: brandon@osuosl.org Delivered-To: philips@osuosl.org Received: from ns1.osuosl.org (ns1.osuosl.org [140.211.166.130]) by shell.osuosl.org (Postfix) with ESMTP id 2795C2F4025 for ; Wed, 13 Sep 2006 09:39:44 -0700 (PDT) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns1.osuosl.org (Postfix) with ESMTP id 0E9233369AD for ; Wed, 13 Sep 2006 09:39:44 -0700 (PDT) Received: from ns1.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 15054-42 for ; Wed, 13 Sep 2006 09:39:42 -0700 (PDT) Received: from secure.lairdnovak.com (jackass2.lairdnovak.com [64.34.179.15]) by ns1.osuosl.org (Postfix) with ESMTP id 922A333670E for ; Wed, 13 Sep 2006 09:39:42 -0700 (PDT) Received: by secure.lairdnovak.com (Postfix) id 4DD0C6582B1; Wed, 13 Sep 2006 16:39:42 +0000 (UTC) Delivered-To: philips@secure.lairdnovak.com Received: from ns1.osuosl.org (ns1.osuosl.org [140.211.166.130]) by secure.lairdnovak.com (Postfix) with ESMTP id 3004F65813C for ; Wed, 13 Sep 2006 16:39:42 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns1.osuosl.org (Postfix) with ESMTP id C572333670E for ; Wed, 13 Sep 2006 09:39:41 -0700 (PDT) Received: from ns1.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 21047-12-2 for ; Wed, 13 Sep 2006 09:39:35 -0700 (PDT) Received: from smtp-out.google.com (smtp-out.google.com [216.239.45.12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ns1.osuosl.org (Postfix) with ESMTP id 5D973336662 for ; Wed, 13 Sep 2006 09:39:35 -0700 (PDT) Received: from zps76.corp.google.com (zps76.corp.google.com [172.25.146.76]) by smtp-out.google.com with ESMTP id k8DGdPvB014543; Wed, 13 Sep 2006 09:39:28 -0700 DomainKey-Signature: a=rsa-sha1; s=beta; d=google.com; c=nofws; q=dns; h=received:message-id:date:from:user-agent: x-accept-language:mime-version:to:cc:subject:references:in-reply-to: content-type:content-transfer-encoding; b=O8JOxFejPLdtA553FUOzlYZZVKZ3ZoFUb25NP7KC9Byl6e7ssVcvPR/+1vMj+8jyA tV/NOfMm9lXEAnSUucGwg== Received: from [172.18.108.59] (mbligh.corp.google.com [172.18.108.59]) by zps76.corp.google.com with ESMTP id k8DGdLtb025731; Wed, 13 Sep 2006 09:39:21 -0700 Message-ID: <45083439.4000305@google.com> Date: Wed, 13 Sep 2006 09:39:21 -0700 From: Martin Bligh User-Agent: Mozilla Thunderbird 1.0.7 (X11/20051011) X-Accept-Language: en-us, en MIME-Version: 1.0 To: Yi Yang Cc: Brandon Philips , autotest@test-kernel.osuosl.org Subject: Re: [Autotest] [PATCH]: Add stress test case References: <44F59F58.4050204@gmail.com> <20060830144126.GB17112@vnet.ibm.com> <44F6F6BA.5050001@google.com> <44F7009E.1090106@gmail.com> <44F7011B.2070900@google.com> <44F70337.6080204@gmail.com> In-Reply-To: <44F70337.6080204@gmail.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.5 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.5 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: Status: RO Content-Length: 1734 Lines: 53 Yi Yang wrote: > Martin J. Bligh 写道: > >>>>> Also, would it be best to use count_cpus() for figuring out the -c >>>>> parameter? >>>> >>>> >>>> Not sure what this does - Yi ? >>> >>> -c just means the number of spawned processes ,so it isn't related to >>> the numder of CPU. >> >> >> >> OK, but do we want the number of processes we use to scale with the size >> of the system? Ie to do a stress test on a 16 CPU system, do we want >> more processes than on a 1 CPU system? >> >> We could do 2x or 4x the number of cpus if you like? Or should it be >> static, and always the same number regardless of the size of the system? > > Of course, I have considered all the arguments as a argument, you can > provide any options at will, for example, job.runtest(None, 'stress', > "-c NNN"), so it has been very changeable now. OK, I set the default to scale with number of CPUs, and people can override it to static if they want. I also made it run a couple of each type of test in parallel ... --- tests/stress/stress.py (revision 180) +++ tests/stress/stress.py (working copy) @@ -12,8 +12,14 @@ system('./configure') system('make') - - def execute(self, iterations = 1, args_list = '-c 4 -t 50 -v'): + + + def execute(self, iterations = 1, args = ''): + if not args: + threads = 2*count_cpus() + args = '-c %d -i %d -m %d -d %d -t 60 -v' % \ + (threads, threads, threads, threads) + for i in range(1, iterations+1): system(self.srcdir + '/src/stress ' + args) Please yell at me if that's wrong. Seems to work OK on my box at least. M. From markh@osdl.org Thu Aug 31 09:35:26 2006 Return-Path: X-Original-To: brandon@osuosl.org Delivered-To: philips@osuosl.org Received: from ns2.osuosl.org (ns2.osuosl.org [140.211.166.131]) by shell.osuosl.org (Postfix) with ESMTP id B9A6162C0D7 for ; Thu, 31 Aug 2006 09:35:26 -0700 (PDT) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns2.osuosl.org (Postfix) with ESMTP id F3142122DB0 for ; Thu, 31 Aug 2006 10:34:10 -0700 (PDT) Received: from ns2.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 19486-44-2 for ; Thu, 31 Aug 2006 10:34:10 -0700 (PDT) Received: from secure.lairdnovak.com (jackass2.lairdnovak.com [64.34.179.15]) by ns2.osuosl.org (Postfix) with ESMTP id C5620122DAC for ; Thu, 31 Aug 2006 10:34:10 -0700 (PDT) Received: by secure.lairdnovak.com (Postfix) id 24FD0658299; Thu, 31 Aug 2006 16:35:26 +0000 (UTC) Delivered-To: philips@secure.lairdnovak.com Received: from ns2.osuosl.org (ns2.osuosl.org [140.211.166.131]) by secure.lairdnovak.com (Postfix) with ESMTP id 0C7DB658195 for ; Thu, 31 Aug 2006 16:35:25 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns2.osuosl.org (Postfix) with ESMTP id A6B80122DB0 for ; Thu, 31 Aug 2006 10:34:09 -0700 (PDT) Received: from ns2.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 19486-44 for ; Thu, 31 Aug 2006 10:34:00 -0700 (PDT) Received: from smtp.osdl.org (smtp.osdl.org [65.172.181.4]) (using TLSv1 with cipher EDH-RSA-DES-CBC3-SHA (168/168 bits)) (No client certificate requested) by ns2.osuosl.org (Postfix) with ESMTP id 06D8C122DAC for ; Thu, 31 Aug 2006 10:33:59 -0700 (PDT) Received: from markh3.pdx.osdl.net (fw.osdl.org [65.172.181.6]) (authenticated bits=0) by smtp.osdl.org (8.12.8/8.12.8) with ESMTP id k7VGZDnW017269 (version=TLSv1/SSLv3 cipher=RC4-MD5 bits=128 verify=NO); Thu, 31 Aug 2006 09:35:14 -0700 Subject: Re: [Autotest] errors trying QuickStart From: Mark Haverkamp To: Brandon Philips Cc: autotest@test-kernel.osuosl.org In-Reply-To: <20060831162952.GA4948@vnet.ibm.com> References: <1157041346.10280.29.camel@markh3.pdx.osdl.net> <20060831162952.GA4948@vnet.ibm.com> Content-Type: text/plain Date: Thu, 31 Aug 2006 09:35:12 -0700 Message-Id: <1157042112.10280.33.camel@markh3.pdx.osdl.net> Mime-Version: 1.0 X-Mailer: Evolution 2.6.3 (2.6.3-1.fc5.5) Content-Transfer-Encoding: 7bit X-Spam-Status: No, hits=-1.066 required=5 tests=AWL,OSDL_HEADER_SUBJECT_BRACKETED X-Spam-Checker-Version: SpamAssassin 2.63-osdl_revision__1.94__ X-MIMEDefang-Filter: osdl$Revision: 1.144 $ X-Scanned-By: MIMEDefang 2.36 X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.6 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.6 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: Status: RO Content-Length: 1148 Lines: 33 On Thu, 2006-08-31 at 11:29 -0500, Brandon Philips wrote: > On 09:22 Thu 31 Aug 2006, Mark Haverkamp wrote: > > I'm trying to get acquainted with autotest and started with the > > QuickStart page. I went thorough the instructions and downloaded the > > various pieces. samples/all_tests went OK. But I had trouble with > > samnples/test_job. Here is what I saw: > > > IOError: [Errno 2] No such file or directory: '/usr/local/autotest/tests/kernbench/linux-2.6.14.tar.bz2' > > Grab http://www.kernel.org/pub/linux/kernel/v2.6/linux-2.6.14.tar.bz2 at > place it in /usr/local/autotest/tests/kernbench/linux-2.6.14.tar.bz2. OK, thanks, I probably should have figured that out. The message was a little confusing since the web page instructions said to put the tar image in /usr/local/src which is where it is. I'll move it and try again. Thanks, Mark. > > This tarball isn't distributed with autotest because of its size. > > An autodownload class to handle this problem for all of the autotest > harnesses that require downloading of files would be much appreciated > ;-) > > Best, > > Brandon -- Mark Haverkamp From philips@vnet.ibm.com Thu Aug 31 09:43:49 2006 Return-Path: X-Original-To: brandon@osuosl.org Delivered-To: philips@osuosl.org Received: from ns2.osuosl.org (ns2.osuosl.org [140.211.166.131]) by shell.osuosl.org (Postfix) with ESMTP id 103FF62C0D7 for ; Thu, 31 Aug 2006 09:43:49 -0700 (PDT) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns2.osuosl.org (Postfix) with ESMTP id 4A2B4122E4A for ; Thu, 31 Aug 2006 10:42:33 -0700 (PDT) Received: from ns2.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 23968-14 for ; Thu, 31 Aug 2006 10:42:24 -0700 (PDT) Received: from secure.lairdnovak.com (jackass2.lairdnovak.com [64.34.179.15]) by ns2.osuosl.org (Postfix) with ESMTP id E6251122E25 for ; Thu, 31 Aug 2006 10:42:23 -0700 (PDT) Received: by secure.lairdnovak.com (Postfix) id 46A33658299; Thu, 31 Aug 2006 16:43:39 +0000 (UTC) Delivered-To: philips@secure.lairdnovak.com Received: from ns2.osuosl.org (ns2.osuosl.org [140.211.166.131]) by secure.lairdnovak.com (Postfix) with ESMTP id 2B40B658195 for ; Thu, 31 Aug 2006 16:43:39 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns2.osuosl.org (Postfix) with ESMTP id 284C6122E37 for ; Thu, 31 Aug 2006 10:42:23 -0700 (PDT) Received: from ns2.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 22030-34-2 for ; Thu, 31 Aug 2006 10:42:17 -0700 (PDT) Received: from e34.co.us.ibm.com (e34.co.us.ibm.com [32.97.110.152]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ns2.osuosl.org (Postfix) with ESMTP id 4DB11122E25 for ; Thu, 31 Aug 2006 10:42:17 -0700 (PDT) Received: from d03relay04.boulder.ibm.com (d03relay04.boulder.ibm.com [9.17.195.106]) by e34.co.us.ibm.com (8.13.8/8.12.11) with ESMTP id k7VGhWxF004050 for ; Thu, 31 Aug 2006 12:43:32 -0400 Received: from d03av04.boulder.ibm.com (d03av04.boulder.ibm.com [9.17.195.170]) by d03relay04.boulder.ibm.com (8.13.6/8.13.6/NCO v8.1.1) with ESMTP id k7VGhVO5181510 for ; Thu, 31 Aug 2006 10:43:31 -0600 Received: from d03av04.boulder.ibm.com (loopback [127.0.0.1]) by d03av04.boulder.ibm.com (8.12.11.20060308/8.13.3) with ESMTP id k7VGhVrW027106 for ; Thu, 31 Aug 2006 10:43:31 -0600 Received: from philips-laptop.austin.ibm.com (dyn9414086.austin.ibm.com [9.41.40.86]) by d03av04.boulder.ibm.com (8.12.11.20060308/8.12.11) with ESMTP id k7VGhVLW027088; Thu, 31 Aug 2006 10:43:31 -0600 Received: by philips-laptop.austin.ibm.com (Postfix, from userid 1000) id DE0B240813C; Thu, 31 Aug 2006 11:43:30 -0500 (CDT) Date: Thu, 31 Aug 2006 11:43:30 -0500 From: Brandon Philips To: Mark Haverkamp Cc: Brandon Philips , autotest@test-kernel.osuosl.org Subject: Re: [Autotest] errors trying QuickStart Message-ID: <20060831164330.GB4948@vnet.ibm.com> References: <1157041346.10280.29.camel@markh3.pdx.osdl.net> <20060831162952.GA4948@vnet.ibm.com> <1157042112.10280.33.camel@markh3.pdx.osdl.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1157042112.10280.33.camel@markh3.pdx.osdl.net> User-Agent: Mutt/1.5.11 X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.6 tagged_above=-999.0 required=5.0 tests=BAYES_00 X-Spam-Level: X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.6 tagged_above=-999.0 required=5.0 tests=BAYES_00 X-Spam-Level: Status: RO Content-Length: 1108 Lines: 24 On 09:35 Thu 31 Aug 2006, Mark Haverkamp wrote: > On Thu, 2006-08-31 at 11:29 -0500, Brandon Philips wrote: > > On 09:22 Thu 31 Aug 2006, Mark Haverkamp wrote: > > > I'm trying to get acquainted with autotest and started with the > > > QuickStart page. I went thorough the instructions and downloaded the > > > various pieces. samples/all_tests went OK. But I had trouble with > > > samnples/test_job. Here is what I saw: > > > > > IOError: [Errno 2] No such file or directory: '/usr/local/autotest/tests/kernbench/linux-2.6.14.tar.bz2' > > > > Grab http://www.kernel.org/pub/linux/kernel/v2.6/linux-2.6.14.tar.bz2 at > > place it in /usr/local/autotest/tests/kernbench/linux-2.6.14.tar.bz2. > > OK, thanks, I probably should have figured that out. The message was a > little confusing since the web page instructions said to put the tar > image in /usr/local/src which is where it is. I'll move it and try > again. Ooops- that was a recent patch. http://test.kernel.org/autotest/QuickStart needs to fixed up as well as samples/test_job since that sample job still uses /usr/local/src. Brandon From mbligh@google.com Thu Aug 31 10:02:26 2006 Return-Path: X-Original-To: brandon@osuosl.org Delivered-To: philips@osuosl.org Received: from ns1.osuosl.org (ns1.osuosl.org [140.211.166.130]) by shell.osuosl.org (Postfix) with ESMTP id 04A2E62C0D7 for ; Thu, 31 Aug 2006 10:02:26 -0700 (PDT) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns1.osuosl.org (Postfix) with ESMTP id C6220BE730 for ; Thu, 31 Aug 2006 10:02:24 -0700 (PDT) Received: from ns1.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 26964-41 for ; Thu, 31 Aug 2006 10:02:15 -0700 (PDT) Received: from secure.lairdnovak.com (jackass2.lairdnovak.com [64.34.179.15]) by ns1.osuosl.org (Postfix) with ESMTP id 50F943367D1 for ; Thu, 31 Aug 2006 10:02:13 -0700 (PDT) Received: by secure.lairdnovak.com (Postfix) id 0900965829A; Thu, 31 Aug 2006 17:02:13 +0000 (UTC) Delivered-To: philips@secure.lairdnovak.com Received: from ns1.osuosl.org (ns1.osuosl.org [140.211.166.130]) by secure.lairdnovak.com (Postfix) with ESMTP id E09FE65813D for ; Thu, 31 Aug 2006 17:02:12 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns1.osuosl.org (Postfix) with ESMTP id BF8DA3367D1 for ; Thu, 31 Aug 2006 10:02:09 -0700 (PDT) Received: from ns1.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 30528-20 for ; Thu, 31 Aug 2006 10:02:05 -0700 (PDT) Received: from smtp-out.google.com (smtp-out.google.com [216.239.45.12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ns1.osuosl.org (Postfix) with ESMTP id 431A13369B8 for ; Thu, 31 Aug 2006 10:02:03 -0700 (PDT) Received: from zps76.corp.google.com (zps76.corp.google.com [172.25.146.76]) by smtp-out.google.com with ESMTP id k7VH1TAa005838; Thu, 31 Aug 2006 10:01:34 -0700 DomainKey-Signature: a=rsa-sha1; s=beta; d=google.com; c=nofws; q=dns; h=received:message-id:date:from:user-agent: x-accept-language:mime-version:to:cc:subject:references:in-reply-to: content-type:content-transfer-encoding; b=D4lSnLo5s53o5h9NMZS65Aw9q3fHdl3drErlMw4kWtsdM36LLp9qn3AI9Dcw2PJgV A/8H+6G+RTJE9WVAuxaHw== Received: from [172.18.108.59] (mbligh.corp.google.com [172.18.108.59]) by zps76.corp.google.com with ESMTP id k7VH1QHk029647; Thu, 31 Aug 2006 10:01:26 -0700 Message-ID: <44F715E6.6080408@google.com> Date: Thu, 31 Aug 2006 10:01:26 -0700 From: Martin Bligh User-Agent: Mozilla Thunderbird 1.0.7 (X11/20051011) X-Accept-Language: en-us, en MIME-Version: 1.0 To: Brandon Philips Cc: Mark Haverkamp , autotest@test-kernel.osuosl.org, Brandon Philips Subject: Re: [Autotest] errors trying QuickStart References: <1157041346.10280.29.camel@markh3.pdx.osdl.net> <20060831162952.GA4948@vnet.ibm.com> <1157042112.10280.33.camel@markh3.pdx.osdl.net> <20060831164330.GB4948@vnet.ibm.com> In-Reply-To: <20060831164330.GB4948@vnet.ibm.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.5 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.5 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: Status: RO Content-Length: 1365 Lines: 33 Brandon Philips wrote: > On 09:35 Thu 31 Aug 2006, Mark Haverkamp wrote: > >>On Thu, 2006-08-31 at 11:29 -0500, Brandon Philips wrote: >> >>>On 09:22 Thu 31 Aug 2006, Mark Haverkamp wrote: >>> >>>>I'm trying to get acquainted with autotest and started with the >>>>QuickStart page. I went thorough the instructions and downloaded the >>>>various pieces. samples/all_tests went OK. But I had trouble with >>>>samnples/test_job. Here is what I saw: >>> >>>>IOError: [Errno 2] No such file or directory: '/usr/local/autotest/tests/kernbench/linux-2.6.14.tar.bz2' >>> >>>Grab http://www.kernel.org/pub/linux/kernel/v2.6/linux-2.6.14.tar.bz2 at >>>place it in /usr/local/autotest/tests/kernbench/linux-2.6.14.tar.bz2. >> >>OK, thanks, I probably should have figured that out. The message was a >>little confusing since the web page instructions said to put the tar >>image in /usr/local/src which is where it is. I'll move it and try >>again. > > > Ooops- that was a recent patch. > > http://test.kernel.org/autotest/QuickStart needs to fixed up as well as > samples/test_job since that sample job still uses /usr/local/src. Ugh ... sorry. easiest to just link it to both places for now, I'll fix it better in a minute to autodetect. One is kernbench source, the other is using it for a compile, they're kind of different purposes. Will isolate it somehow. From mbligh@google.com Thu Aug 31 10:16:51 2006 Return-Path: X-Original-To: brandon@osuosl.org Delivered-To: philips@osuosl.org Received: from ns1.osuosl.org (ns1.osuosl.org [140.211.166.130]) by shell.osuosl.org (Postfix) with ESMTP id DCA0362C0D7 for ; Thu, 31 Aug 2006 10:16:51 -0700 (PDT) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns1.osuosl.org (Postfix) with ESMTP id BD83B336692 for ; Thu, 31 Aug 2006 10:16:51 -0700 (PDT) Received: from ns1.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 01060-15-2 for ; Thu, 31 Aug 2006 10:16:42 -0700 (PDT) Received: from secure.lairdnovak.com (jackass2.lairdnovak.com [64.34.179.15]) by ns1.osuosl.org (Postfix) with ESMTP id DEACA336A80 for ; Thu, 31 Aug 2006 10:16:41 -0700 (PDT) Received: by secure.lairdnovak.com (Postfix) id 7FF4565829A; Thu, 31 Aug 2006 17:16:41 +0000 (UTC) Delivered-To: philips@secure.lairdnovak.com Received: from ns2.osuosl.org (ns2.osuosl.org [140.211.166.131]) by secure.lairdnovak.com (Postfix) with ESMTP id 6482C65813D for ; Thu, 31 Aug 2006 17:16:41 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns2.osuosl.org (Postfix) with ESMTP id 4EFF6122F71 for ; Thu, 31 Aug 2006 11:15:25 -0700 (PDT) Received: from ns2.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 25856-31 for ; Thu, 31 Aug 2006 11:15:15 -0700 (PDT) Received: from smtp-out.google.com (smtp-out.google.com [216.239.45.12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ns2.osuosl.org (Postfix) with ESMTP id AE17F122970 for ; Thu, 31 Aug 2006 11:15:15 -0700 (PDT) Received: from zps75.corp.google.com (zps75.corp.google.com [172.25.146.75]) by smtp-out.google.com with ESMTP id k7VHGLJm023285; Thu, 31 Aug 2006 10:16:21 -0700 DomainKey-Signature: a=rsa-sha1; s=beta; d=google.com; c=nofws; q=dns; h=received:message-id:date:from:user-agent: x-accept-language:mime-version:to:cc:subject:references:in-reply-to: content-type:content-transfer-encoding; b=kZTWbVJFkMCh3I3kPjXPJE7hOOJy9UhtcfBSbzV3AaOfudjglaIo/8UKfyrC05sE2 PHtitR4EXSdPFAdSpLRLA== Received: from [172.18.108.59] (mbligh.corp.google.com [172.18.108.59]) by zps75.corp.google.com with ESMTP id k7VHGGY3026818; Thu, 31 Aug 2006 10:16:16 -0700 Message-ID: <44F71960.2030001@google.com> Date: Thu, 31 Aug 2006 10:16:16 -0700 From: Martin Bligh User-Agent: Mozilla Thunderbird 1.0.7 (X11/20051011) X-Accept-Language: en-us, en MIME-Version: 1.0 To: Martin Bligh Cc: Brandon Philips , autotest@test-kernel.osuosl.org, Brandon Philips Subject: Re: [Autotest] errors trying QuickStart References: <1157041346.10280.29.camel@markh3.pdx.osdl.net> <20060831162952.GA4948@vnet.ibm.com> <1157042112.10280.33.camel@markh3.pdx.osdl.net> <20060831164330.GB4948@vnet.ibm.com> <44F715E6.6080408@google.com> In-Reply-To: <44F715E6.6080408@google.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.4 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.5 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: Status: RO Content-Length: 1422 Lines: 35 >> Ooops- that was a recent patch. >> >> http://test.kernel.org/autotest/QuickStart needs to fixed up as well as >> samples/test_job since that sample job still uses /usr/local/src. > > > Ugh ... sorry. easiest to just link it to both places for now, I'll fix > it better in a minute to autodetect. > > One is kernbench source, the other is using it for a compile, they're > kind of different purposes. Will isolate it somehow. I cheated. This way most people can use /usr/local/src, and Brandon can still make kernbench work in the local dir if need be. And the wiki instructions will work. M. Index: tests/kernbench/kernbench.py =================================================================== --- tests/kernbench/kernbench.py (revision 178) +++ tests/kernbench/kernbench.py (revision 180) @@ -6,7 +6,10 @@ def setup(self): # http://kernel.org/pub/linux/kernel/v2.6/linux-2.6.14.tar.bz2 - tarball = self.bindir + '/linux-2.6.14.tar.bz2' + if (os.path.exists(self.bindir + '/linux-2.6.14.tar.bz2')): + tarball = self.bindir + '/linux-2.6.14.tar.bz2' + else: + tarball = '/usr/local/src/linux-2.6.14.tar.bz2' kernel = self.job.kernel(self.srcdir, tarball) kernel.config('') # have to save this off, as we might use it in another run From mbligh@google.com Thu Aug 31 09:54:02 2006 Return-Path: X-Original-To: brandon@osuosl.org Delivered-To: philips@osuosl.org Received: from ns2.osuosl.org (ns2.osuosl.org [140.211.166.131]) by shell.osuosl.org (Postfix) with ESMTP id B0A8762C0D7 for ; Thu, 31 Aug 2006 09:54:02 -0700 (PDT) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns2.osuosl.org (Postfix) with ESMTP id EA152122711 for ; Thu, 31 Aug 2006 10:52:46 -0700 (PDT) Received: from ns2.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 22869-49-3 for ; Thu, 31 Aug 2006 10:52:46 -0700 (PDT) Received: from secure.lairdnovak.com (jackass2.lairdnovak.com [64.34.179.15]) by ns2.osuosl.org (Postfix) with ESMTP id BA4A41226EA for ; Thu, 31 Aug 2006 10:52:46 -0700 (PDT) Received: by secure.lairdnovak.com (Postfix) id E4146658299; Thu, 31 Aug 2006 16:54:01 +0000 (UTC) Delivered-To: philips@secure.lairdnovak.com Received: from ns2.osuosl.org (ns2.osuosl.org [140.211.166.131]) by secure.lairdnovak.com (Postfix) with ESMTP id B2250658195 for ; Thu, 31 Aug 2006 16:54:01 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns2.osuosl.org (Postfix) with ESMTP id 88A9312278A for ; Thu, 31 Aug 2006 10:52:45 -0700 (PDT) Received: from ns2.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 22869-49 for ; Thu, 31 Aug 2006 10:52:36 -0700 (PDT) Received: from smtp-out.google.com (smtp-out.google.com [216.239.45.12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ns2.osuosl.org (Postfix) with ESMTP id 0FBC81226EA for ; Thu, 31 Aug 2006 10:52:35 -0700 (PDT) Received: from zps35.corp.google.com (zps35.corp.google.com [172.25.146.35]) by smtp-out.google.com with ESMTP id k7VGrSBp010784; Thu, 31 Aug 2006 09:53:28 -0700 DomainKey-Signature: a=rsa-sha1; s=beta; d=google.com; c=nofws; q=dns; h=received:message-id:date:from:user-agent: x-accept-language:mime-version:to:cc:subject:references:in-reply-to: content-type:content-transfer-encoding; b=amg8CRPOVZdRHmntC45RorO4pcpK1ayD5LBs5kKX3btaK6oYLlMgZbMeVeZfR61oI 3fuK+OsVXChaZ8TtMIJaw== Received: from [172.18.108.59] (mbligh.corp.google.com [172.18.108.59]) by zps35.corp.google.com with ESMTP id k7VGrJVY030406; Thu, 31 Aug 2006 09:53:19 -0700 Message-ID: <44F713FF.5020207@google.com> Date: Thu, 31 Aug 2006 09:53:19 -0700 From: Martin Bligh User-Agent: Mozilla Thunderbird 1.0.7 (X11/20051011) X-Accept-Language: en-us, en MIME-Version: 1.0 To: Brandon Philips Cc: Mark Haverkamp , autotest@test-kernel.osuosl.org Subject: Re: [Autotest] errors trying QuickStart References: <1157041346.10280.29.camel@markh3.pdx.osdl.net> <20060831162952.GA4948@vnet.ibm.com> In-Reply-To: <20060831162952.GA4948@vnet.ibm.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.4 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.4 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: Status: RO Content-Length: 947 Lines: 25 Brandon Philips wrote: > On 09:22 Thu 31 Aug 2006, Mark Haverkamp wrote: > >>I'm trying to get acquainted with autotest and started with the >>QuickStart page. I went thorough the instructions and downloaded the >>various pieces. samples/all_tests went OK. But I had trouble with >>samnples/test_job. Here is what I saw: > > >>IOError: [Errno 2] No such file or directory: '/usr/local/autotest/tests/kernbench/linux-2.6.14.tar.bz2' > > > Grab http://www.kernel.org/pub/linux/kernel/v2.6/linux-2.6.14.tar.bz2 at > place it in /usr/local/autotest/tests/kernbench/linux-2.6.14.tar.bz2. > > This tarball isn't distributed with autotest because of its size. > > An autodownload class to handle this problem for all of the autotest > harnesses that require downloading of files would be much appreciated > ;-) I suppose we could always do a foul hack, and just make that test try doing wget ... would prefer to solve it properly though M. From bryce@osdl.org Thu Aug 31 11:19:01 2006 Return-Path: X-Original-To: brandon@osuosl.org Delivered-To: philips@osuosl.org Received: from ns1.osuosl.org (ns1.osuosl.org [140.211.166.130]) by shell.osuosl.org (Postfix) with ESMTP id 17D6A62C0D7 for ; Thu, 31 Aug 2006 11:19:01 -0700 (PDT) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns1.osuosl.org (Postfix) with ESMTP id F1ACA336710 for ; Thu, 31 Aug 2006 11:19:00 -0700 (PDT) Received: from ns1.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 27056-58 for ; Thu, 31 Aug 2006 11:18:50 -0700 (PDT) Received: from secure.lairdnovak.com (jackass2.lairdnovak.com [64.34.179.15]) by ns1.osuosl.org (Postfix) with ESMTP id 68E20336711 for ; Thu, 31 Aug 2006 11:18:50 -0700 (PDT) Received: by secure.lairdnovak.com (Postfix) id 0EDCE65829B; Thu, 31 Aug 2006 18:18:50 +0000 (UTC) Delivered-To: philips@secure.lairdnovak.com Received: from ns2.osuosl.org (ns2.osuosl.org [140.211.166.131]) by secure.lairdnovak.com (Postfix) with ESMTP id D0E2C65829A for ; Thu, 31 Aug 2006 18:18:49 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns2.osuosl.org (Postfix) with ESMTP id 5CA04122F97 for ; Thu, 31 Aug 2006 12:17:33 -0700 (PDT) Received: from ns2.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 04459-38 for ; Thu, 31 Aug 2006 12:17:28 -0700 (PDT) Received: from smtp.osdl.org (smtp.osdl.org [65.172.181.4]) (using TLSv1 with cipher EDH-RSA-DES-CBC3-SHA (168/168 bits)) (No client certificate requested) by ns2.osuosl.org (Postfix) with ESMTP id DA9AB12268E for ; Thu, 31 Aug 2006 12:17:27 -0700 (PDT) Received: from localhost (fw.osdl.org [65.172.181.6]) (authenticated bits=0) by smtp.osdl.org (8.12.8/8.12.8) with ESMTP id k7VIIYnW023606 (version=TLSv1/SSLv3 cipher=EDH-RSA-DES-CBC3-SHA bits=168 verify=NO); Thu, 31 Aug 2006 11:18:35 -0700 Date: Thu, 31 Aug 2006 11:18:34 -0700 From: Bryce Harrington To: Martin Bligh Cc: Brandon Philips , autotest@test-kernel.osuosl.org Subject: Automatic package downloading (was Re: [Autotest] errors trying QuickStart) Message-ID: <20060831181834.GB12170@osdl.org> References: <1157041346.10280.29.camel@markh3.pdx.osdl.net> <20060831162952.GA4948@vnet.ibm.com> <44F713FF.5020207@google.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <44F713FF.5020207@google.com> User-Agent: Mutt/1.5.11 X-Spam-Status: No, hits=-0.395 required=5 tests=AWL X-Spam-Checker-Version: SpamAssassin 2.63-osdl_revision__1.94__ X-MIMEDefang-Filter: osdl$Revision: 1.144 $ X-Scanned-By: MIMEDefang 2.36 X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.3 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.6 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: Status: RO Content-Length: 5682 Lines: 129 On Thu, Aug 31, 2006 at 09:53:19AM -0700, Martin Bligh wrote: > >Grab http://www.kernel.org/pub/linux/kernel/v2.6/linux-2.6.14.tar.bz2 at > >place it in /usr/local/autotest/tests/kernbench/linux-2.6.14.tar.bz2. > > > >This tarball isn't distributed with autotest because of its size. > > > >An autodownload class to handle this problem for all of the autotest > >harnesses that require downloading of files would be much appreciated > >;-) > > I suppose we could always do a foul hack, and just make that test try > doing wget ... would prefer to solve it properly though This particular problem is one that I ran into for the NFS testing, and came up with a general purpose solution that works well. I use it with crucible, but it is a standalone tool and could be used to solve this whole class of problems for autotest, too. The package is called WWW::PkgFind, and can be downloaded either through CPAN or from the crucible SF site. (Yes, that means it's in Perl; deal with it. ;-P ) It is essentially a wget wrapper plus a web scraper/spider, that lets you specify the things you want to autodownload in a nice simple config file, using regular expressions. Here's an example of the syntax: PACKAGE: dbench URL: http://samba.org/ftp/tridge/dbench/ DEPTH: 0 WANTED: ^dbench-.*\.tar\.gz$ This will look on tridge's webpage for new dbench releases and download them. Easy. Of course, tridge doesn't release new dbench packages that often, so this is of limited usefulness. Here's a more practical example. New releases of LTP come out every month, and they're posted to SF, which has that annoying but handy mirror setup for file releases: PACKAGE: ltp URL: http://prdownloads.sourceforge.net/ltp/ DEPTH: 0 WANTED: ltp-full.*\.tgz$ MIRRORS: superb-west,superb-east,umn,easynews,switch,surfnet,heanet MIRROR_URL: http://MIRROR.dl.sourceforge.net/sourceforge/ltp/FILENAME WWW::PkgFind picks one of your specified mirrors at random and substitutes it into the MIRROR_URL, along with the released file name. Notice how this uses the WANTED regex to ensure we get only the ltp full tarballs, since that's all I care about. Now to the problem at hand, here is what we have to download andrew morton's -mm kernels: PACKAGE: linux URL: http://kernel.org/pub/linux/kernel/people/akpm/patches/2.6/ DEPTH: 3 WANTED: ^2\.6\..*-mm\d+\.bz2$ NOTWANTED: ^2\.6\.\d\..*bz2$ NOTWANTED: ^2\.6\.\d-.*bz2$ NOTWANTED: broken-out Andrew's patches are a bit more challenging since he stores them in a tree structure, but it's no problem; we let pkgfind navigate into the directory structure 3 levels down, but ignore the broken-out stuff. Also notice how we've used the NOTWANTED regexp's to exclude patches before 2.6.10. These are just normal perl regular expressions so you're free to tap your regex know-how as deeply as you want. Personally I like to keep them simple so it's easier to tell that they're going to work. WWW::PkgFind also sorts the files into a directory structure. That way you can keep your ltp packages separate from your linux packages. Of course, simply downloading packages isn't sufficient - you also want to trigger tests against them. The simplest idea I could think of was to just put symlinks to the newly downloaded files into a queue directory. Then whatever test harness you're running just needs to delete that symlink after it's had a chance to take a look and do something with it. I generally leave all my downloaded packages in my file system, but if you want to reclaim space, a simple way to do this is to leave the files in place but zero them out. WWW::PkgFind figures if the file already exists on the file system, it won't re-download them. (A nice consequence of this is that if a given package was corrupted during download, just delete it and it'll be redownloaded the next time your pkgfind cronjob runs.) So if you only care about the latest kernels, and want to minimize the disk space required, you could have your test harness zero out packages when all your machines have finished with them, or when suitable time passes. Now, not all projects kindly posts snapshots to web or ftp sites. Kernel developers frequently use git. So WWW::PkgFind also includes a git-pkgfind bash script which can be used to watch and pull patches from git trees automatically. It will only pull a patch if there has been a change. It also creates the symlinks as above, so these can be processed the same way as stuff pulled from websites. Here is a couple examples of what we use this for: http://crucible.osdl.org/runs/branches.html http://crucible.osdl.org/runs/cairo_report.html We are also developing similar SVN and CVS pullers. Since autotest hasn't put out any official releases, we are finding we need an SVN puller to let us run autotest in crucible (currently we've just been making manual snapshots of autotest to run, but too we're lazy to keep that up.) Presently, you may be interested only in this tool for purposes of auto-downloading kernels. However, I would also strongly encourage you to consider it for downloading tests as well. Certainly it is convenient to have the tests included in autotest's SVN in a single bundle, and avoids potential bitrot and other problems. However, at the rate people are sending in more and more tests, this package is going to get huge. Keeping all these things updated is going to require more and more of your time as the things scales up. If there are changes to it necessary to work better with autotest, we'd be happy to look into that, and of course will accept patches. Bryce From mbligh@google.com Fri Sep 1 08:50:30 2006 Return-Path: X-Original-To: brandon@osuosl.org Delivered-To: philips@osuosl.org Received: from ns2.osuosl.org (ns2.osuosl.org [140.211.166.131]) by shell.osuosl.org (Postfix) with ESMTP id 6BD8862C0D7 for ; Fri, 1 Sep 2006 08:50:30 -0700 (PDT) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns2.osuosl.org (Postfix) with ESMTP id 9602512361E for ; Fri, 1 Sep 2006 09:49:14 -0700 (PDT) Received: from ns2.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 01485-71 for ; Fri, 1 Sep 2006 09:49:04 -0700 (PDT) Received: from secure.lairdnovak.com (jackass2.lairdnovak.com [64.34.179.15]) by ns2.osuosl.org (Postfix) with ESMTP id 7FD38123608 for ; Fri, 1 Sep 2006 09:49:04 -0700 (PDT) Received: by secure.lairdnovak.com (Postfix) id E70BF6582A2; Fri, 1 Sep 2006 15:50:19 +0000 (UTC) Delivered-To: philips@secure.lairdnovak.com Received: from ns1.osuosl.org (ns1.osuosl.org [140.211.166.130]) by secure.lairdnovak.com (Postfix) with ESMTP id BD2AD65813D for ; Fri, 1 Sep 2006 15:50:19 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by ns1.osuosl.org (Postfix) with ESMTP id 5F1EE336C34 for ; Fri, 1 Sep 2006 08:50:19 -0700 (PDT) Received: from ns1.osuosl.org ([127.0.0.1]) by localhost (ns1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 14749-64 for ; Fri, 1 Sep 2006 08:50:14 -0700 (PDT) Received: from smtp-out.google.com (smtp-out.google.com [216.239.45.12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ns1.osuosl.org (Postfix) with ESMTP id E47E93368BC for ; Fri, 1 Sep 2006 08:50:13 -0700 (PDT) Received: from zps77.corp.google.com (zps77.corp.google.com [172.25.146.77]) by smtp-out.google.com with ESMTP id k81FoB2C015178; Fri, 1 Sep 2006 08:50:11 -0700 DomainKey-Signature: a=rsa-sha1; s=beta; d=google.com; c=nofws; q=dns; h=received:message-id:date:from:user-agent:mime-version:to:cc: subject:references:in-reply-to:content-type:content-transfer-encoding; b=o1A7IiP1fO9FerdTMrDr6CynZQGuJ1DI3L2Z8li3Z4HvqJsTgjPvEQDft+ZrVKnW9 sKrQdjEPfm1jU3Rx7IZYg== Received: from smtp.corp.google.com (mordor.corp.google.com [192.168.15.226]) by zps77.corp.google.com with ESMTP id k81Fo4h6006873 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Fri, 1 Sep 2006 08:50:04 -0700 Received: from [10.10.1.2] ([67.170.239.34]) (authenticated bits=0) by smtp.corp.google.com (8.13.7/8.13.7) with ESMTP id k81Fo4o7031383 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Fri, 1 Sep 2006 08:50:04 -0700 Message-ID: <44F8566F.6030204@google.com> Date: Fri, 01 Sep 2006 08:49:03 -0700 From: "Martin J. Bligh" User-Agent: Thunderbird 1.5.0.5 (X11/20060728) MIME-Version: 1.0 To: Bryce Harrington Cc: Brandon Philips , autotest@test-kernel.osuosl.org Subject: Re: Automatic package downloading (was Re: [Autotest] errors trying QuickStart) References: <1157041346.10280.29.camel@markh3.pdx.osdl.net> <20060831162952.GA4948@vnet.ibm.com> <44F713FF.5020207@google.com> <20060831181834.GB12170@osdl.org> In-Reply-To: <20060831181834.GB12170@osdl.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.6 tagged_above=-999.0 required=5.0 tests=BAYES_00 X-Spam-Level: X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at osuosl.org X-Spam-Status: No, hits=-2.6 tagged_above=-999.0 required=5.0 tests=AWL, BAYES_00 X-Spam-Level: Status: RO Content-Length: 4662 Lines: 100 Bryce Harrington wrote: > On Thu, Aug 31, 2006 at 09:53:19AM -0700, Martin Bligh wrote: >>> Grab http://www.kernel.org/pub/linux/kernel/v2.6/linux-2.6.14.tar.bz2 at >>> place it in /usr/local/autotest/tests/kernbench/linux-2.6.14.tar.bz2. >>> >>> This tarball isn't distributed with autotest because of its size. >>> >>> An autodownload class to handle this problem for all of the autotest >>> harnesses that require downloading of files would be much appreciated >>> ;-) >> I suppose we could always do a foul hack, and just make that test try >> doing wget ... would prefer to solve it properly though > > This particular problem is one that I ran into for the NFS testing, and > came up with a general purpose solution that works well. I use it with > crucible, but it is a standalone tool and could be used to solve this > whole class of problems for autotest, too. > > The package is called WWW::PkgFind, and can be downloaded either through > CPAN or from the crucible SF site. (Yes, that means it's in Perl; deal > with it. ;-P ) > > It is essentially a wget wrapper plus a web scraper/spider, that lets > you specify the things you want to autodownload in a nice simple config > file, using regular expressions. Here's an example of the syntax: ... > Here's a more practical example. New releases of LTP come out every > month, and they're posted to SF, which has that annoying but handy > mirror setup for file releases: Looks very trick ... but ... do we really *want* to do that? The point of encapsulating the test source within autotest was to keep it stable. You really don't want to be changing "stuff under test" (eg kernel version) and the test itself at the same time. Changing more than one element at once means you don't know where results differences actually came from. > Now to the problem at hand, here is what we have to download andrew > morton's -mm kernels: That'd be more useful. There are some other ways to do that, but if it does things like ... > Now, not all projects kindly posts snapshots to web or ftp sites. > Kernel developers frequently use git. So WWW::PkgFind also includes a > git-pkgfind bash script which can be used to watch and pull patches from > git trees automatically. It will only pull a patch if there has been a > change. It also creates the symlinks as above, so these can be > processed the same way as stuff pulled from websites. Here is a couple > examples of what we use this for: ... that as well, would be more useful. > http://crucib