History log of /5.5.2/testrunner/pysystests/testcfg.py (Results 1 - 21 of 21)
Revision (<<< Hide revision tags) (Show revision tags >>>) Date Author Comments
Revision tags: 4.6.0, testrunner-ng-old, watson-moxi, 4.5.0, 4.1.0, 4.0.0, 3.0.2, 3.0.1, 3.0.0
# 78e314d3 11-Sep-2014 Sangharsh Agarwal <sangharsh.agarwal@globallogic.com>

CBQE-0: added test_cfg file for KV_Windows_XDCR system test

Change-Id: I7781dd6ae160fdc3166bf06eef5745776a10f846
Reviewed-on: http://review.couchbase.org/41360
Reviewed-by: Sangharsh

CBQE-0: added test_cfg file for KV_Windows_XDCR system test

Change-Id: I7781dd6ae160fdc3166bf06eef5745776a10f846
Reviewed-on: http://review.couchbase.org/41360
Reviewed-by: Sangharsh Agarwal <sangharsh.agarwal@globallogic.com>
Tested-by: Sangharsh Agarwal <sangharsh.agarwal@globallogic.com>

show more ...


# 70ef657c 13-May-2014 Tommie McAfee <tommie@couchbase.com>

CBQE-0: simplify default testcfg.py

making testcfg.py more generic for simpliest setup

Change-Id: I38941aec654285617e19f9e6e8e895c0eec7be81
Reviewed-on: http://review.couchbase.

CBQE-0: simplify default testcfg.py

making testcfg.py more generic for simpliest setup

Change-Id: I38941aec654285617e19f9e6e8e895c0eec7be81
Reviewed-on: http://review.couchbase.org/37049
Tested-by: buildbot <build@couchbase.com>
Reviewed-by: Aruna Piravi <aruna@couchbase.com>

show more ...


# f7770853 21-Apr-2014 arunapiravi <arunapiravi86@gmail.com>

runsystest.py - automation script for system tests

Usage:
python runsystest.py --build 3.0.0-588 --params vbuckets=1024,xdcr_upr=false,upr=true --exclude inspect,install,rabbitmq,seriesl

runsystest.py - automation script for system tests

Usage:
python runsystest.py --build 3.0.0-588 --params vbuckets=1024,xdcr_upr=false,upr=true --exclude inspect,install,rabbitmq,seriesly,worker,cluster,cbmonitor,systest,stats
--build required param indicating which version-build the system test is to be run on
--params optional param to specify additional installer options
--exclude optional param to specify which steps to exclude

Change-Id: I993e0029e80571a4827908b3d4fc5d0cdc95bcbe
Reviewed-on: http://review.couchbase.org/35929
Reviewed-by: Tommie McAfee <tommie@couchbase.com>
Tested-by: Aruna Piravi <aruna@couchbase.com>

show more ...


Revision tags: 2.5.1
# c205f8e6 20-Nov-2013 Tommie McAfee <tommie@couchbase.com>

CBQE-1712: support gevented python sdk

changes the underlying sdk implementation to the source in consumer.py,
which uses the python gevented sdk.

Also this change isolates the

CBQE-1712: support gevented python sdk

changes the underlying sdk implementation to the source in consumer.py,
which uses the python gevented sdk.

Also this change isolates the loader from the worker so that cluster can be loaded
as standalone without celery,rabbitmq,memcached with the --standalone option:

python cbsystest.py run workload --create 100 --ops 80000 --cluster default --standalone

Another feature is that only 1 worker needs to be started in the entire client-ecosystem.
any helper vms will simply need to run ./consumer.py --cluster <name>

Change-Id: I6d0241d13c5e377d08e906ba0b5e40c08402548d
Reviewed-on: http://review.couchbase.org/30429
Reviewed-by: Tommie McAfee <tommie@couchbase.com>
Tested-by: Tommie McAfee <tommie@couchbase.com>

show more ...


Revision tags: 2.1.1r
# ba140f35 12-Jun-2013 Tommie McAfee <tommie@couchbase.com>

CBST-4: fix-ssh tag forces linux os

Change-Id: I71ace0760a6401621d217657e372fb488c29bf18
Reviewed-on: http://review.couchbase.org/26917
Reviewed-by: Thuan Nguyen <soccon@gmail.com>

CBST-4: fix-ssh tag forces linux os

Change-Id: I71ace0760a6401621d217657e372fb488c29bf18
Reviewed-on: http://review.couchbase.org/26917
Reviewed-by: Thuan Nguyen <soccon@gmail.com>
Tested-by: Tommie McAfee <tommie@couchbase.com>

show more ...


Revision tags: 2.1.0r, 2.0.2r
# 3f55abb0 13-May-2013 Tommie McAfee <tommie@couchbase.com>

CBQE-0: update old testcfg with new params

When a new param is added to testcfg add it to backed up testcfg

Change-Id: I67e13aeb3308bd9841b66a8d6cf8d566918cdd88
Committer: tommi

CBQE-0: update old testcfg with new params

When a new param is added to testcfg add it to backed up testcfg

Change-Id: I67e13aeb3308bd9841b66a8d6cf8d566918cdd88
Committer: tommie@couchbase.com
Reviewed-on: http://review.couchbase.org/26270
Tested-by: buildbot <build@couchbase.com>
Reviewed-by: Tommie McAfee <tommie@couchbase.com>

show more ...


# 63ecb394 07-May-2013 Tommie McAfee <tommie@couchbase.com>

CBQE-1275: remove ini dep during setup/teardown

update testcfg to contain only information about local cluster
and reference to remote site. note this also removes ini depends.
samp

CBQE-1275: remove ini dep during setup/teardown

update testcfg to contain only information about local cluster
and reference to remote site. note this also removes ini depends.
samples of doing end2end setup/teardown included.

support will be added to wrap setup/teardown/test in a single runlist

Change-Id: I7da9baeae657ba56267bb4619d8e2c80ca3ff27b
Reviewed-on: http://review.couchbase.org/26164
Tested-by: buildbot <build@couchbase.com>
Reviewed-by: Chisheng Hong <chisheng@couchbase.com>
Tested-by: Chisheng Hong <chisheng@couchbase.com>
Reviewed-by: Tommie McAfee <tommie@couchbase.com>

show more ...


# 4dd197ae 12-Apr-2013 Chisheng Hong <chisheng@couchbase.com>

CBQE-1183 add cluster ips to testcfg.py to initialize cluster status obj

Also for the update cluster status task, we support multiple
cluster status obj updating

Change-Id: I00c

CBQE-1183 add cluster ips to testcfg.py to initialize cluster status obj

Also for the update cluster status task, we support multiple
cluster status obj updating

Change-Id: I00ca5dddc51f7bc60523be442da7de2e9209645d
Reviewed-on: http://review.couchbase.org/25626
Reviewed-by: Tommie McAfee <tommie@couchbase.com>
Tested-by: buildbot <build@couchbase.com>

show more ...


# 7c58465c 10-Apr-2013 Chisheng Hong <chisheng@couchbase.com>

CBQE-1183 able to define number of initial nodes for clusters(include xdcr usage)

In system test automation, when we setup the initial cluster,
we sometimes won't use all the nodes defin

CBQE-1183 able to define number of initial nodes for clusters(include xdcr usage)

In system test automation, when we setup the initial cluster,
we sometimes won't use all the nodes defined in our ini file.
Like view ssd linux, for example, we will have 9 nodes in ini file
but we only want to start the test with 7 in cluster.

Cluster status is able to remember all the available nodes info
for the system test

And Due to this change http://review.couchbase.org/#/c/25405/,
user may restart and continue the system test with -I app.init
But we only want to setup the cluster just once, at the beginning
of the test. So we make cluster setup true or false option as celery
command option.

If you want to setup the cluster, celery worker command is:
celery worker -A app -B -c 8 -l ERROR --purge -I app.init,app.setup

Change-Id: Ib54705bd225ec2fb4ffd554c2abb17b561a969c6
Reviewed-on: http://review.couchbase.org/25422
Reviewed-by: Tommie McAfee <tommie@couchbase.com>
Tested-by: buildbot <build@couchbase.com>

show more ...


Revision tags: 2.0.1-macosx, 2.0.1-windows, 2.0.1-linux
# 5c31538b 25-Feb-2013 abhinavdangeti <abhinav@couchbase.com>

CBQE-791: Initialize nodes/buckets (sys tests)

- Options for bucket size

Change-Id: I08f1a03692734aa17816cda44f87ed5475700759
Reviewed-on: http://review.couchbase.org/24845

CBQE-791: Initialize nodes/buckets (sys tests)

- Options for bucket size

Change-Id: I08f1a03692734aa17816cda44f87ed5475700759
Reviewed-on: http://review.couchbase.org/24845
Reviewed-by: abhinav dangeti <abhinav.dangeti@gmail.com>
Tested-by: abhinav dangeti <abhinav.dangeti@gmail.com>

show more ...


# 846b5061 12-Feb-2013 abhinavdangeti <abhinav@couchbase.com>

CBQE-791: Initialize nodes/clusters and buckets

- Added functionality to set up clusters,
and buckets (before setting up seriesly)
- Sets up XDCR as well
- use option: "x

CBQE-791: Initialize nodes/clusters and buckets

- Added functionality to set up clusters,
and buckets (before setting up seriesly)
- Sets up XDCR as well
- use option: "xdcr=True"
- for bidirection: "rdirection=bidirection"
- Just XDCR can be setup at any point, if
clusters already created.
- setupXDCR, with option "xdcr=True"
- for bidirection: "rdirection=bidirection"

Change-Id: I77bb3266c84bef6714443090f2e05ef629eac698
Reviewed-on: http://review.couchbase.org/24431
Tested-by: abhinav dangeti <abhinav.dangeti@gmail.com>
Reviewed-by: abhinav dangeti <abhinav.dangeti@gmail.com>

show more ...


# 7bf35998 15-Jan-2013 Tommie McAfee <tommie@couchbase.com>

CBQE-572: init seriesly only if stats requested

Change-Id: I25d1fb177e46532962619ea6aa89e6898d9ba937
Reviewed-on: http://review.couchbase.org/23962
Reviewed-by: Chisheng Hong <chishe

CBQE-572: init seriesly only if stats requested

Change-Id: I25d1fb177e46532962619ea6aa89e6898d9ba937
Reviewed-on: http://review.couchbase.org/23962
Reviewed-by: Chisheng Hong <chisheng@couchbase.com>
Tested-by: Chisheng Hong <chisheng@couchbase.com>
Tested-by: buildbot <build@couchbase.com>

show more ...


# 4ee5062f 11-Jan-2013 Chisheng Hong <chisheng@couchbase.com>

CBQE-962 Clean up previous data in seriesly db when celery starts

When celery starts, we need to clean up previous data stored
in seriesly database from last run.

Change-Id: I8

CBQE-962 Clean up previous data in seriesly db when celery starts

When celery starts, we need to clean up previous data stored
in seriesly database from last run.

Change-Id: I80e0daf23f56d6cdc49d70abb56a95020fde7d84
Reviewed-on: http://review.couchbase.org/23761
Reviewed-by: Chisheng Hong <chisheng@couchbase.com>
Tested-by: Chisheng Hong <chisheng@couchbase.com>

show more ...


# 34d6496e 29-Oct-2012 Tommie McAfee <tommie@couchbase.com>

CBQE-572: stop using default vhost

use CB_CLUSTER_TAG in as broker virtual host path where queues can be found
to further ensure no conflict in sending tasks from multiple workers.

CBQE-572: stop using default vhost

use CB_CLUSTER_TAG in as broker virtual host path where queues can be found
to further ensure no conflict in sending tasks from multiple workers.

Change-Id: If5c43920f5570512136e37b0f83ea7bb38288b06
Reviewed-on: http://review.couchbase.org/22040
Reviewed-by: Chisheng Hong <chisheng@couchbase.com>
Tested-by: Tommie McAfee <tommie@couchbase.com>

show more ...


# b78a0728 14-Oct-2012 Tommie McAfee <tommie@couchbase.com>

CBQE-572: Enhancements to systest framework

Allow for shared broker across clusters
* testcfg.py specify cluster name as prefix to queues

Better message routing
* all

CBQE-572: Enhancements to systest framework

Allow for shared broker across clusters
* testcfg.py specify cluster name as prefix to queues

Better message routing
* all tasks for each worker type has a specific route
so that traffic will be isolated and not picked up
by any worker listening to 'default' queue

Auto-delete unused queues
* set auto-delete = True for all queues to have them
removed when worker no longer needs them.

Support for using celeryd-multi to start several
worker instances on a single vm:
* this is useful to protecting against losing
jobs across the entire worker when an unrelated
task crashes the worker. I.E key-value loader crashes
and stop collection is killed.

examaple of starting 4 isolated workers on one vm with 2 process dedicated to each:

celeryd-multi start kv query admin stats -A app --purge -l ERROR -B -I:kv app.init \
-n:kv kv -n:query query -n:admin admin -n:stats stats -c 2

Where syntax (-n:kv kv) means for worker named kv, start the kv scheduler , create it's queues and routes
Note also init is only started once along with the kv worker, although it can be started as standalone.

To start all types in a single worker do:

celeryd-multi start all -A app --purge -l ERROR -B -n:all all -c 8

One worker with two schedulers:

celeryd-multi start kv query -A app --purge -l ERROR -B -I:kv app.init \
-n:kv kv -n:query query -c 4

Change-Id: I0054da50e31fdbe9b279daa033e461bfa00f31b2
Reviewed-on: http://review.couchbase.org/21632
Reviewed-by: Karan Kumar <karan@couchbase.com>
Tested-by: Tommie McAfee <tommie@couchbase.com>

show more ...


# 707d5b64 12-Oct-2012 Tommie McAfee <tommie@couchbase.com>

CBQE-572: allow defining worker type

Allow tester to specify behavior of worker.
This allows worker to be just used for
stat colleciton, queries, admin tasks, etc.

Change-Id

CBQE-572: allow defining worker type

Allow tester to specify behavior of worker.
This allows worker to be just used for
stat colleciton, queries, admin tasks, etc.

Change-Id: I08393efbd3b49a4d5cdde1e09e2b1915d03a7612
Reviewed-on: http://review.couchbase.org/21611
Reviewed-by: Karan Kumar <karan@couchbase.com>
Tested-by: Tommie McAfee <tommie@couchbase.com>

show more ...


# 5450b35d 27-Sep-2012 Tommie McAfeee <tommie@couchbase.com>

CBQE-572: celery-process and stat logging to files

Change-Id: I0ce22eabc2f53cdbb9d98d785bc7df43327872ee
Reviewed-on: http://review.couchbase.org/21172
Reviewed-by: Tommie McAfee <tom

CBQE-572: celery-process and stat logging to files

Change-Id: I0ce22eabc2f53cdbb9d98d785bc7df43327872ee
Reviewed-on: http://review.couchbase.org/21172
Reviewed-by: Tommie McAfee <tommie@couchbase.com>
Tested-by: Tommie McAfee <tommie@couchbase.com>

show more ...


# 1cdaa685 27-Sep-2012 Karan Kumar <karan@couchbase.com>

CBQE-624: Added more admin operations

* Support backup functionality
* async execute admin ops

Change-Id: I99307239b8105815a33926648ba73d478e06a62f
Reviewed-on: http://revie

CBQE-624: Added more admin operations

* Support backup functionality
* async execute admin ops

Change-Id: I99307239b8105815a33926648ba73d478e06a62f
Reviewed-on: http://review.couchbase.org/21158
Tested-by: Karan Kumar <karan@couchbase.com>
Reviewed-by: Tommie McAfee <tommie@couchbase.com>
Tested-by: buildbot <build@couchbase.com>

show more ...


# 5e187386 19-Sep-2012 Tommie McAfeee <tommie@couchbase.com>

CBQE-613: atop stat collection from nodes

This change add collection of system stats
from running nodes via atop. Samples are
cached along with running workload to be
later anal

CBQE-613: atop stat collection from nodes

This change add collection of system stats
from running nodes via atop. Samples are
cached along with running workload to be
later analyzed at end of test

Change-Id: I715bc5671a1ff2ef4bb9c4055c14f6ef81261035
Reviewed-on: http://review.couchbase.org/20970
Tested-by: buildbot <build@couchbase.com>
Reviewed-by: Karan Kumar <karan@couchbase.com>

show more ...


# a05dbe3e 03-Sep-2012 Tommie McAfee <tommie@couchbase.com>

Systest: pass user/pwd to statchecker

Change-Id: I72e83cc09a4118d42c4e51bf764df65710bbe98f
Reviewed-on: http://review.couchbase.org/20444
Reviewed-by: Tommie McAfee <tommie@couchbase

Systest: pass user/pwd to statchecker

Change-Id: I72e83cc09a4118d42c4e51bf764df65710bbe98f
Reviewed-on: http://review.couchbase.org/20444
Reviewed-by: Tommie McAfee <tommie@couchbase.com>
Tested-by: Tommie McAfee <tommie@couchbase.com>

show more ...


# 330a0995 30-Jul-2012 Tommie McAfee <tommie@couchbase.com>

Systest Platform

Initial check in of platform for system testing.
Adding pysystest directory which contains
a python-celery application that operates as a
worker for performing t

Systest Platform

Initial check in of platform for system testing.
Adding pysystest directory which contains
a python-celery application that operates as a
worker for performing tasks. Package also
consists of a cbsystest.py command line interface
for defining and running new workloads.
Currently python and ruby are supported sdks
for handling underlying requests to the couch cluster.

Environmental Vars:
testcfg.py

Starting celery worker with scheduler(-B):
celery worker -A app -B

Running a workload:
1) Define simple document template:
python cbsystest.py import template --name "default" --kvpair ' "hello":"world"
2) Run workload using predifined template at 1k ops/sec
python cbsystest.py run workload --create 50 --get 50 --ops 1000 --cc_queues docs_to_consume --template "default

Change-Id: I5979b5f9ac3ddc4581f7f64899abdd4c8166a510
Reviewed-on: http://review.couchbase.org/19019
Reviewed-by: Tommie McAfee <tommie@couchbase.com>
Tested-by: Tommie McAfee <tommie@couchbase.com>

show more ...