History log of /5.5.2/testrunner/pysystests/cbsystest.py (Results 1 - 23 of 23)
Revision (<<< Hide revision tags) (Show revision tags >>>) Date Author Comments
Revision tags: 4.6.0, testrunner-ng-old, watson-moxi, 4.5.0, 4.1.0, 4.0.0, 3.0.2, 3.0.1, 3.0.0
# d3c4c14b 05-Aug-2014 Tommie McAfee <tommie@couchbase.com>

CBQE-0: systest avoid flushq in standalone mode

standalone mode is a quick way to use loader without full infrastructure
(broker/cache/..etc) which means occasional flushing keys to rabb

CBQE-0: systest avoid flushq in standalone mode

standalone mode is a quick way to use loader without full infrastructure
(broker/cache/..etc) which means occasional flushing keys to rabbitmq
should be disabled

Change-Id: I79d39f1f79cebfa15b0148ab0648878285f86c23
Reviewed-on: http://review.couchbase.org/40309
Tested-by: buildbot <build@couchbase.com>
Reviewed-by: Tommie McAfee <tommie@couchbase.com>

show more ...


Revision tags: 2.5.1
# c205f8e6 20-Nov-2013 Tommie McAfee <tommie@couchbase.com>

CBQE-1712: support gevented python sdk

changes the underlying sdk implementation to the source in consumer.py,
which uses the python gevented sdk.

Also this change isolates the

CBQE-1712: support gevented python sdk

changes the underlying sdk implementation to the source in consumer.py,
which uses the python gevented sdk.

Also this change isolates the loader from the worker so that cluster can be loaded
as standalone without celery,rabbitmq,memcached with the --standalone option:

python cbsystest.py run workload --create 100 --ops 80000 --cluster default --standalone

Another feature is that only 1 worker needs to be started in the entire client-ecosystem.
any helper vms will simply need to run ./consumer.py --cluster <name>

Change-Id: I6d0241d13c5e377d08e906ba0b5e40c08402548d
Reviewed-on: http://review.couchbase.org/30429
Reviewed-by: Tommie McAfee <tommie@couchbase.com>
Tested-by: Tommie McAfee <tommie@couchbase.com>

show more ...


Revision tags: 2.1.1r, 2.1.0r, 2.0.2r
# e9c0f315 03-May-2013 Tommie McAfee <tommie@couchbase.com>

CBQE-0: only setup parsers when run from cli

this change is necessary so that we can import methods from this module

Change-Id: Iff42acc78ae300cf63e0058089e39dc2ffacf3d3
Reviewe

CBQE-0: only setup parsers when run from cli

this change is necessary so that we can import methods from this module

Change-Id: Iff42acc78ae300cf63e0058089e39dc2ffacf3d3
Reviewed-on: http://review.couchbase.org/26067
Reviewed-by: Chisheng Hong <chisheng@couchbase.com>
Tested-by: Tommie McAfee <tommie@couchbase.com>

show more ...


# 11ff3f61 12-Apr-2013 Tommie McAfee <tommie@couchbase.com>

CBQE-0: rabbit_helper allow vhost arg

we also need to support passing the --cluster
value used in cbsystest to automate other workers

Change-Id: I2acdbdb82730c90f532bd875f004ca2

CBQE-0: rabbit_helper allow vhost arg

we also need to support passing the --cluster
value used in cbsystest to automate other workers

Change-Id: I2acdbdb82730c90f532bd875f004ca2496203540
Reviewed-on: http://review.couchbase.org/25644
Tested-by: buildbot <build@couchbase.com>
Reviewed-by: Chisheng Hong <chisheng@couchbase.com>

show more ...


Revision tags: 2.0.1-macosx, 2.0.1-windows
# 04752206 18-Mar-2013 Tommie McAfeee <tommie@couchbase.com>

CBQE-966: define index_key in query workload

this change makes it so that indexed_key can be defined
in query workload. previously the template needed to
be defined and this templat

CBQE-966: define index_key in query workload

this change makes it so that indexed_key can be defined
in query workload. previously the template needed to
be defined and this template had indexed key.

Change-Id: I9326776f0df66c23de2538d825ce2c4fb634d706
Reviewed-on: http://review.couchbase.org/25207
Reviewed-by: Tommie McAfee <tommie@couchbase.com>
Reviewed-by: Chisheng Hong <chisheng@couchbase.com>
Tested-by: buildbot <build@couchbase.com>

show more ...


# 43011717 11-Mar-2013 Tommie McAfeee <tommie@couchbase.com>

CBQE-1124: remove indexed_key as required param

Change-Id: I8f8a9ad2611eeb9548e267504795b4c209f9efb9
Reviewed-on: http://review.couchbase.org/25091
Tested-by: buildbot <build@couchba

CBQE-1124: remove indexed_key as required param

Change-Id: I8f8a9ad2611eeb9548e267504795b4c209f9efb9
Reviewed-on: http://review.couchbase.org/25091
Tested-by: buildbot <build@couchbase.com>
Reviewed-by: Thuan Nguyen <soccon@gmail.com>

show more ...


# 158ffb42 05-Mar-2013 Tommie McAfeee <tommie@couchbase.com>

CBQE-683: add dynamic queries to system-test

Adding new QueryBuilder class which monitors
active workload for help generating smart range queries.

There will be a new param in t

CBQE-683: add dynamic queries to system-test

Adding new QueryBuilder class which monitors
active workload for help generating smart range queries.

There will be a new param in the import template command
specifying which key in the template is indexed

python cbsystest.py import template --name "default" --kvpair '"email":"$str10@couchbase.com" ' '"city":"$str5"' --indexed email

Indexed param tells querybuilder to watch the email key in the template for generating queries.
It is assumed user already created the ddoc that indexes on this key.

Query command syntax will be updated as well. by default we do startkey/endkey queries. extra can filters can be added like so:
python cbsystest.py run query ... --include_filters startkey_docid endkey_docid

Or removed (no range)
python cbsystest.py run query ... --exclude_filters startkey endkey

Or manually specified

python cbsystest.py run query ... --startkey abc --endkey zzz

Change-Id: I64117b57aeb7d62638011d500e6dcd13a4bfa911
Reviewed-on: http://review.couchbase.org/24996
Tested-by: buildbot <build@couchbase.com>
Tested-by: Tommie McAfee <tommie@couchbase.com>
Reviewed-by: Chisheng Hong <chisheng@couchbase.com>

show more ...


Revision tags: 2.0.1-linux
# 215405d8 11-Feb-2013 Tommie McAfeee <tommie@couchbase.com>

CBQE-819: rename purge/delete queue methods

Current purge queue method in rabbit_helper actually deletes the queue.
This change replaces it with the proper purging functionality and

CBQE-819: rename purge/delete queue methods

Current purge queue method in rabbit_helper actually deletes the queue.
This change replaces it with the proper purging functionality and
makes a separate method for deletes.

Change-Id: I83cad7b47c12940bb5f2de72eaf5e1f8da355f9f
Reviewed-on: http://review.couchbase.org/24516
Tested-by: Tommie McAfee <tommie@couchbase.com>
Reviewed-by: Tommie McAfee <tommie@couchbase.com>

show more ...


# 87b4b8b4 31-Jan-2013 Tommie McAfeee <tommie@couchbase.com>

CBQE-1004: template support various doc size

example: python cbsystest.py .... --size 128 256 512

Change-Id: I4a9df0332bcd6f60d17f947c4b807a7915f1237b
Reviewed-on: http://rev

CBQE-1004: template support various doc size

example: python cbsystest.py .... --size 128 256 512

Change-Id: I4a9df0332bcd6f60d17f947c4b807a7915f1237b
Reviewed-on: http://review.couchbase.org/24333
Reviewed-by: Ketaki Gangal <ketakigangal@gmail.com>
Tested-by: buildbot <build@couchbase.com>

show more ...


# 0666eda4 05-Nov-2012 Tommie McAfeee <tommie@couchbase.com>

CBQE-731: control cache miss ratio

(required that consume queue contains ejected keys to work properly)
Ex: python cbsystest.py run workload --cluster plum --get 60 --create 40 --miss 2

CBQE-731: control cache miss ratio

(required that consume queue contains ejected keys to work properly)
Ex: python cbsystest.py run workload --cluster plum --get 60 --create 40 --miss 2 --consume_queue ejectset --cc_queues hotset --ops 5000

from tests/cachemiss.js:
"3" :
{
"name" : "cache_miss",
"desc" : "Access ejected set with 2% miss ratio",
"workload" :"g:80,m:2,coq:ejectset,s:20,ccq:hotset,ops:5000"
}

Change-Id: I0fb37680bb225f147c3b0c2e6fb3487e717329b8
Reviewed-on: http://review.couchbase.org/22267
Tested-by: buildbot <build@couchbase.com>
Reviewed-by: Chisheng Hong <chisheng@couchbase.com>
Tested-by: Chisheng Hong <chisheng@couchbase.com>

show more ...


# 7936714b 02-Nov-2012 Tommie McAfeee <tommie@couchbase.com>

CBQE-572: when no message recv delete rc_queue

Change-Id: I94704927e1ffc54b2485315327d91e5620023c1d
Reviewed-on: http://review.couchbase.org/22224
Reviewed-by: Tommie McAfee <tommie@

CBQE-572: when no message recv delete rc_queue

Change-Id: I94704927e1ffc54b2485315327d91e5620023c1d
Reviewed-on: http://review.couchbase.org/22224
Reviewed-by: Tommie McAfee <tommie@couchbase.com>
Tested-by: Tommie McAfee <tommie@couchbase.com>

show more ...


# 0a8e2bc6 01-Nov-2012 Tommie McAfeee <tommie@couchbase.com>

CBQE-572: add key expiration at workload level

Currently only supported with template itself:
python cbsystest.py run workload --cluster "plum" --cc_queue testset --update 10 --update 60

CBQE-572: add key expiration at workload level

Currently only supported with template itself:
python cbsystest.py run workload --cluster "plum" --cc_queue testset --update 10 --update 60 --get 20 --delete 5 --expire 5 --ttl 30 --ops 10000

Change-Id: Id5c6caa02f13552412e80b6989f827b82508f560
Reviewed-on: http://review.couchbase.org/22211
Reviewed-by: Ketaki Gangal <ketakigangal@gmail.com>
Tested-by: Tommie McAfee <tommie@couchbase.com>

show more ...


# fabfebc8 29-Oct-2012 Tommie McAfee <tommie@couchbase.com>

CBQE-572: saslbucket workload and query support

Change-Id: I9d9bfb8aa01c67957c9eed4a51c72054bf730c45
Reviewed-on: http://review.couchbase.org/22049
Reviewed-by: Tommie McAfee <tommie

CBQE-572: saslbucket workload and query support

Change-Id: I9d9bfb8aa01c67957c9eed4a51c72054bf730c45
Reviewed-on: http://review.couchbase.org/22049
Reviewed-by: Tommie McAfee <tommie@couchbase.com>
Tested-by: Tommie McAfee <tommie@couchbase.com>

show more ...


# 5f634895 27-Oct-2012 Tommie McAfee <tommie@couchbase.com>

CBQE-572: make cbsystest.py "restful"

Provide a callback key in the command request,
and listen to the queue with same name as the key
for a response. timeout after 5 seconds.

CBQE-572: make cbsystest.py "restful"

Provide a callback key in the command request,
and listen to the queue with same name as the key
for a response. timeout after 5 seconds.

Change-Id: Ibffdfcf4d17e84fc137c629d179b4f484eff9e86
Reviewed-on: http://review.couchbase.org/22033
Tested-by: Chisheng Hong <chisheng@couchbase.com>
Reviewed-by: Tommie McAfee <tommie@couchbase.com>

show more ...


# 7bc79d74 25-Oct-2012 Tommie McAfeee <tommie@couchbase.com>

CBQE-714: grouping systests into runlists

update cbsystest.py command to read in file name
of remote test. if test has runlist key then
import and run list of remote tests

CBQE-714: grouping systests into runlists

update cbsystest.py command to read in file name
of remote test. if test has runlist key then
import and run list of remote tests

runlist.js -
{
"runlist" : ["simple", "conditions", "rebalance"]
}

Change-Id: Idc5827f4950bf338ed0c94a3c5d02888fe7c7a1a
Reviewed-on: http://review.couchbase.org/21952
Reviewed-by: Karan Kumar <karan@couchbase.com>
Tested-by: Tommie McAfee <tommie@couchbase.com>

show more ...


# 30583c37 24-Oct-2012 Tommie McAfeee <tommie@couchbase.com>

CBQE-714: accept test cases to systest automation

Test case defined as a series of phases.
This is initial implementation of reading in a
json file as a test case of phases and runni

CBQE-714: accept test cases to systest automation

Test case defined as a series of phases.
This is initial implementation of reading in a
json file as a test case of phases and running
the same way cli would.

Example:
python cbsystest.py run test --fromfile tests/simple.js --cluster "plum"

Change-Id: If36420b61e85ea66de1efc338d5e0edf718a04b3
Reviewed-on: http://review.couchbase.org/21934
Tested-by: buildbot <build@couchbase.com>
Reviewed-by: Karan Kumar <karan@couchbase.com>

show more ...


# b78a0728 14-Oct-2012 Tommie McAfee <tommie@couchbase.com>

CBQE-572: Enhancements to systest framework

Allow for shared broker across clusters
* testcfg.py specify cluster name as prefix to queues

Better message routing
* all

CBQE-572: Enhancements to systest framework

Allow for shared broker across clusters
* testcfg.py specify cluster name as prefix to queues

Better message routing
* all tasks for each worker type has a specific route
so that traffic will be isolated and not picked up
by any worker listening to 'default' queue

Auto-delete unused queues
* set auto-delete = True for all queues to have them
removed when worker no longer needs them.

Support for using celeryd-multi to start several
worker instances on a single vm:
* this is useful to protecting against losing
jobs across the entire worker when an unrelated
task crashes the worker. I.E key-value loader crashes
and stop collection is killed.

examaple of starting 4 isolated workers on one vm with 2 process dedicated to each:

celeryd-multi start kv query admin stats -A app --purge -l ERROR -B -I:kv app.init \
-n:kv kv -n:query query -n:admin admin -n:stats stats -c 2

Where syntax (-n:kv kv) means for worker named kv, start the kv scheduler , create it's queues and routes
Note also init is only started once along with the kv worker, although it can be started as standalone.

To start all types in a single worker do:

celeryd-multi start all -A app --purge -l ERROR -B -n:all all -c 8

One worker with two schedulers:

celeryd-multi start kv query -A app --purge -l ERROR -B -I:kv app.init \
-n:kv kv -n:query query -c 4

Change-Id: I0054da50e31fdbe9b279daa033e461bfa00f31b2
Reviewed-on: http://review.couchbase.org/21632
Reviewed-by: Karan Kumar <karan@couchbase.com>
Tested-by: Tommie McAfee <tommie@couchbase.com>

show more ...


# f6c49776 09-Oct-2012 Tommie McAfee <tommie@couchbase.com>

CBQE-683: query support for system test

Specify querys per second, design doc and view name.
Currently working for single non-sasl bucket.

Change-Id: Ie2bd057cfcdbf6be1f7fa2ac0b

CBQE-683: query support for system test

Specify querys per second, design doc and view name.
Currently working for single non-sasl bucket.

Change-Id: Ie2bd057cfcdbf6be1f7fa2ac0b70903f86eae777
Reviewed-on: http://review.couchbase.org/21455
Tested-by: Tommie McAfee <tommie@couchbase.com>
Reviewed-by: Tommie McAfee <tommie@couchbase.com>

show more ...


# 41be4345 03-Oct-2012 Tommie McAfee <tommie@couchbase.com>

CBQE-572: add broker arg to cbsystest cli

Allow sending commands to different brokers.
Currently only the rabbit server specified
in the config file is used

Change-Id: I5248

CBQE-572: add broker arg to cbsystest cli

Allow sending commands to different brokers.
Currently only the rabbit server specified
in the config file is used

Change-Id: I52486d7fd07ffddff4147188dbaf26ab1d67c48c
Reviewed-on: http://review.couchbase.org/21289
Reviewed-by: Tommie McAfee <tommie@couchbase.com>
Tested-by: Tommie McAfee <tommie@couchbase.com>

show more ...


# 32f69fce 02-Oct-2012 Karan Kumar <karan@couchbase.com>

CBQE-624: Add support for xdcr

* Create uni/bi directional replications

Change-Id: I92cde3b084b69252dcd0ce68db926230db3f4645
Reviewed-on: http://review.couchbase.org/21253
T

CBQE-624: Add support for xdcr

* Create uni/bi directional replications

Change-Id: I92cde3b084b69252dcd0ce68db926230db3f4645
Reviewed-on: http://review.couchbase.org/21253
Tested-by: Karan Kumar <karan@couchbase.com>
Reviewed-by: Tommie McAfee <tommie@couchbase.com>

show more ...


# b14a4fec 26-Sep-2012 Karan Kumar <karan@couchbase.com>

CBQE-624: Support admin operations

Support following admin ops:
* rebalance in
* rebalance out
* failover+rebalance out and only failover
* soft/hard restart

Change

CBQE-624: Support admin operations

Support following admin ops:
* rebalance in
* rebalance out
* failover+rebalance out and only failover
* soft/hard restart

Change-Id: If4f62457aa1882bf3470e768b58ea22c90221283
Reviewed-on: http://review.couchbase.org/21103
Reviewed-by: Tommie McAfee <tommie@couchbase.com>
Tested-by: Tommie McAfee <tommie@couchbase.com>

show more ...


# 260333c0 10-Sep-2012 Tommie McAfee <tommie@ubu-1809.hq.couchbase.com>

CBQE-572: fix for systest template doc size

support passing template size argument through
cbsystest command and create padding within sdk handler.

Change-Id: I68819a6c09c704c6f

CBQE-572: fix for systest template doc size

support passing template size argument through
cbsystest command and create padding within sdk handler.

Change-Id: I68819a6c09c704c6ff0d650d18302b32cce625ca
Reviewed-on: http://review.couchbase.org/20694
Tested-by: Tommie McAfee <tommie@couchbase.com>
Reviewed-by: Tommie McAfee <tommie@couchbase.com>

show more ...


# 330a0995 30-Jul-2012 Tommie McAfee <tommie@couchbase.com>

Systest Platform

Initial check in of platform for system testing.
Adding pysystest directory which contains
a python-celery application that operates as a
worker for performing t

Systest Platform

Initial check in of platform for system testing.
Adding pysystest directory which contains
a python-celery application that operates as a
worker for performing tasks. Package also
consists of a cbsystest.py command line interface
for defining and running new workloads.
Currently python and ruby are supported sdks
for handling underlying requests to the couch cluster.

Environmental Vars:
testcfg.py

Starting celery worker with scheduler(-B):
celery worker -A app -B

Running a workload:
1) Define simple document template:
python cbsystest.py import template --name "default" --kvpair ' "hello":"world"
2) Run workload using predifined template at 1k ops/sec
python cbsystest.py run workload --create 50 --get 50 --ops 1000 --cc_queues docs_to_consume --template "default

Change-Id: I5979b5f9ac3ddc4581f7f64899abdd4c8166a510
Reviewed-on: http://review.couchbase.org/19019
Reviewed-by: Tommie McAfee <tommie@couchbase.com>
Tested-by: Tommie McAfee <tommie@couchbase.com>

show more ...