History log of /5.5.2/couchdb/ (Results 226 - 250 of 3942)
Revision (<<< Hide revision tags) (Show revision tags >>>)Date Author Comments
(<<< Hide modified files)
(Show modified files >>>)
e34cf8e207-Nov-2014 Volker Mische <vmx@couchbase.com>

MB-12048: Add test for upgrading header from 2.x to 3.x

There was a unit test missing that the upgrading from a Couchbase 2.x
to a 3.x view file really works.

Change-Id: I819f7a

MB-12048: Add test for upgrading header from 2.x to 3.x

There was a unit test missing that the upgrading from a Couchbase 2.x
to a 3.x view file really works.

Change-Id: I819f7a1594e73765223871da5f1652826f1b926c
Reviewed-on: http://review.couchbase.org/42933
Reviewed-by: Volker Mische <volker.mische@gmail.com>
Reviewed-by: Nimish Gupta <nimish@couchbase.com>
Tested-by: Volker Mische <volker.mische@gmail.com>

show more ...

232747b406-Nov-2014 Volker Mische <vmx@couchbase.com>

Make test logging more verbose

With the `--verbose` set the test logging output is more verbose.
The output on the screen is still the same it only changes what
gets written to the l

Make test logging more verbose

With the `--verbose` set the test logging output is more verbose.
The output on the screen is still the same it only changes what
gets written to the log file.

Change-Id: Iedaf4612d406450a2fc25e6066e325aa137915cf
Reviewed-on: http://review.couchbase.org/42893
Reviewed-by: Volker Mische <volker.mische@gmail.com>
Reviewed-by: Dave Rigby <daver@couchbase.com>
Tested-by: buildbot <build@couchbase.com>
Reviewed-by: Sarath Lakshman <sarath@couchbase.com>

show more ...

529883ba12-Aug-2014 harsha <hhs.couchbase@gmail.com>

MB-11755 Receive memcached messages in bulk

Receive worker in DCP client handled memcached messages
individually, reading header first and any extra bytes
as indicated in header. Thi

MB-11755 Receive memcached messages in bulk

Receive worker in DCP client handled memcached messages
individually, reading header first and any extra bytes
as indicated in header. This resulted in making several
thousands of tcp receive calls per design doc and
resulted in timeouts while handling stat responses from
memcached. This behavior is modified to receive all the
available data for memcached from socket and process each
individual response from the stored binary, which results
in far few tcp receive calls. Socket connection is made
active and buffer size is set to 64K, same as TCP window
size. More than 2x increase in speed is observed for
accesses to stat responses from memcached.

Change-Id: I5b25f3ed15b6825b8e88fac6e1eb4d1e5dbe3c5f
Reviewed-on: http://review.couchbase.org/40570
Reviewed-by: Sarath Lakshman <sarath@couchbase.com>
Tested-by: buildbot <build@couchbase.com>
Reviewed-by: Volker Mische <volker.mische@gmail.com>
Reviewed-by: Harsha H S <hhs.couchbase@gmail.com>
Tested-by: Harsha H S <hhs.couchbase@gmail.com>

show more ...

1cf5cbe331-Oct-2014 Volker Mische <vmx@couchbase.com>

MB-12251 Don't log stacktrace on query parse errors

Change-Id: I437f736a9e268244450de0538e93a102b2c2d38e
Reviewed-on: http://review.couchbase.org/42672
Reviewed-by: Volker Mische <vo

MB-12251 Don't log stacktrace on query parse errors

Change-Id: I437f736a9e268244450de0538e93a102b2c2d38e
Reviewed-on: http://review.couchbase.org/42672
Reviewed-by: Volker Mische <volker.mische@gmail.com>
Tested-by: buildbot <build@couchbase.com>
Reviewed-by: Sarath Lakshman <sarath@couchbase.com>

show more ...

c34007e315-Oct-2014 Volker Mische <vmx@couchbase.com>

MB-12357 Make customs errors in updater possible

When there was an error in the updater it is not possible to send
a custom error. So if you throw a custom error:

throw({cus

MB-12357 Make customs errors in updater possible

When there was an error in the updater it is not possible to send
a custom error. So if you throw a custom error:

throw({custom_error, <<"this is the reason">>)

Such an error was always wrappen into another error tuple, hence
ending up as:

{error, {custom_error, <<"this is the reason">>}}

This lead to a user visible response of:

{"error":"error","reason":"{custom_error,<<\"this is the reason\">>}"}

This is not user-friendy or what you would expect. With this commit
the response is:

{"error":"custom_error","reason":"this is the reason"}

Change-Id: If68ffb9d5b8d70de338a9441ed74edb2aa28f33a
Reviewed-on: http://review.couchbase.org/42163
Reviewed-by: Volker Mische <volker.mische@gmail.com>
Reviewed-by: Sarath Lakshman <sarath@couchbase.com>
Tested-by: buildbot <build@couchbase.com>

show more ...

f0c69b1602-Oct-2014 Volker Mische <vmx@couchbase.com>

Make geocouch's dialyzer happy

geocouch uses some of the couchdb functions, hence some type specs
need to be adapted in order to make the dialyzer run on geocouch
happy.

Cha

Make geocouch's dialyzer happy

geocouch uses some of the couchdb functions, hence some type specs
need to be adapted in order to make the dialyzer run on geocouch
happy.

Change-Id: Iaea98815ac8670d7222c181f6d11d406ff5295a9
Reviewed-on: http://review.couchbase.org/41951
Tested-by: buildbot <build@couchbase.com>
Reviewed-by: Sarath Lakshman <sarath@couchbase.com>

show more ...

2897407824-Sep-2014 Volker Mische <vmx@couchbase.com>

MB-12112 Add option to add search paths to unit test run script

It's now possible to add additional search paths for beam files via
the "-f" option. It expects a format that can be used

MB-12112 Add option to add search paths to unit test run script

It's now possible to add additional search paths for beam files via
the "-f" option. It expects a format that can be used in ERL_FLAGS.

This makes it possible for geocouch to add additional modules needed
to run the unit tests. It's about test helpers residing in the the
`test` subdirectory of the geocouch apps.

Change-Id: I339ff146a4920db0d59a8eafb02cf910e2dc02a1
Reviewed-on: http://review.couchbase.org/41762
Tested-by: buildbot <build@couchbase.com>
Reviewed-by: Volker Mische <volker.mische@gmail.com>

show more ...

82a9257002-Oct-2014 Volker Mische <vmx@couchbase.com>

Check whether PLT file is outdated or not

Erlang's dialyzer creates a PLT file for static analysis. Creating
such a file takes a long time, hence it's preserved between builds
on the

Check whether PLT file is outdated or not

Erlang's dialyzer creates a PLT file for static analysis. Creating
such a file takes a long time, hence it's preserved between builds
on the build bots.

It can happen that the PLT file is outdated and needs to be
regenerated. This commits adds the automated regeneration.

Change-Id: I1194c8db44a662821e8f55d435ee2e34d4c61707
Reviewed-on: http://review.couchbase.org/41814
Reviewed-by: Sarath Lakshman <sarath@couchbase.com>
Tested-by: buildbot <build@couchbase.com>
Reviewed-by: Volker Mische <volker.mische@gmail.com>

show more ...

efc2e92823-Sep-2014 Volker Mische <vmx@couchbase.com>

MB-12112 Simplify unit test runner

The unit test runner `runtest.py` needed the source as well as the
build directory of couchdb. This didn't work well as ERL_LIBS picks
the first ap

MB-12112 Simplify unit test runner

The unit test runner `runtest.py` needed the source as well as the
build directory of couchdb. This didn't work well as ERL_LIBS picks
the first application it encounters without checking if there might
be one which contains missing files later in the path.

The build system was changes so that the build directory also includes
the header files, hence only the information about the build path is
needed.

The `source` parameter got renamed to `libsdirs` and now takes a
directory as input that will be added to the ERL_LIBS environment
variable. This enables geocouch to use the same test runner.

All the subdirectories from the supplied couchdb build directory are
now added to erl_flags. This way you don't need to supply as many
modules as previously.

Change-Id: I07d5c40071ea85342ef72d2e64acf9feda0fb25c
Reviewed-on: http://review.couchbase.org/41581
Reviewed-by: Sarath Lakshman <sarath@couchbase.com>
Reviewed-by: Volker Mische <volker.mische@gmail.com>
Tested-by: buildbot <build@couchbase.com>

show more ...

3824c9a002-Sep-2014 Volker Mische <vmx@couchbase.com>

MB-12112: Streamline CMake files

With an improved ERL_BUILD_OTP macro less code is needed within
the individual CMakeLists.txt files.

Change-Id: I9b03b82194dc787715730d3adb2bc59

MB-12112: Streamline CMake files

With an improved ERL_BUILD_OTP macro less code is needed within
the individual CMakeLists.txt files.

Change-Id: I9b03b82194dc787715730d3adb2bc599af162d0a
Reviewed-on: http://review.couchbase.org/41147
Reviewed-by: Sarath Lakshman <sarath@couchbase.com>
Reviewed-by: Chris Hillery <ceej@couchbase.com>
Reviewed-by: Trond Norbye <trond.norbye@gmail.com>
Tested-by: Trond Norbye <trond.norbye@gmail.com>

show more ...

8b066e9304-Sep-2014 Sarath Lakshman <sarathlakshman@slynux.com>

MB-12128 Add a unit test to verify RYOW property of stale=false query

When a user issues a stale=false query, it should ensure RYOW property.
That means if a document is modified and a s

MB-12128 Add a unit test to verify RYOW property of stale=false query

When a user issues a stale=false query, it should ensure RYOW property.
That means if a document is modified and a stale=false query is issued,
the user should see atleast his change or changes that happened later
in the corresponding view index entries.

Added a unit test case to validate read your own write (RYOW) property
statisfied by stale=false queries.

Change-Id: I1c07c9f7a622e76abda55fb0775f72270679308d
Reviewed-on: http://review.couchbase.org/41192
Reviewed-by: Volker Mische <volker.mische@gmail.com>
Tested-by: buildbot <build@couchbase.com>

show more ...

cfade5fb01-Sep-2014 Sarath Lakshman <sarathlakshman@slynux.com>

MB-12128 Revert "Optimize for improving stale=false query latency"

The reverted commit breaks stale=false query's RYOW property

This reverts commit e866fe9330336ab1bda92743e0bd99453

MB-12128 Revert "Optimize for improving stale=false query latency"

The reverted commit breaks stale=false query's RYOW property

This reverts commit e866fe9330336ab1bda92743e0bd994530532cc8.

Change-Id: I051833e3ddad39ae28e93fff1eff4f79e36b18f4
Reviewed-on: http://review.couchbase.org/41193
Reviewed-by: Volker Mische <volker.mische@gmail.com>
Reviewed-by: Sarath Lakshman <sarath@couchbase.com>
Tested-by: buildbot <build@couchbase.com>

show more ...

c2af28d203-Sep-2014 Sarath Lakshman <sarathlakshman@slynux.com>

MB-12110 Extract snapshot marker type correctly

Snapshot type is determined by extracting the corresponding bits
in the marker type bit fields from snapshot marker upr message.

MB-12110 Extract snapshot marker type correctly

Snapshot type is determined by extracting the corresponding bits
in the marker type bit fields from snapshot marker upr message.

The current implementation checked for equality of snapshot marker
type field with on-disk or in-memory marker type. But, EP-Engine
may send snapshot marker with other bits set as well. In that case
snapshot marker is ignored and snapshot boundaries are missed out
by the updater. Since the snapshot merger fails to detect the
snapshot boundary, multiple entries for a document ends up in
the updater pipeline and duplicates are added into the index.

Change-Id: Ic58df6ec438dc3b2791fe4225a95748737c781e2
Reviewed-on: http://review.couchbase.org/41167
Reviewed-by: Sarath Lakshman <sarath@couchbase.com>
Reviewed-by: Volker Mische <volker.mische@gmail.com>
Reviewed-by: Sriram Melkote <siri@couchbase.com>
Reviewed-by: Michael Wiederhold <mike@couchbase.com>
Reviewed-by: Nimish Gupta <nimish@couchbase.com>
Tested-by: buildbot <build@couchbase.com>

show more ...

3d30674921-Aug-2014 Volker Mische <volker.mische@gmail.com>

Revert "MB-11919 Log sequence number difference in indexing"

This change was for debugging purpose and doesn't add much
value. Hence it would make sense to revert it to have the
logs

Revert "MB-11919 Log sequence number difference in indexing"

This change was for debugging purpose and doesn't add much
value. Hence it would make sense to revert it to have the
logs less noisy.

This reverts commit ce07551ae81163f8645373c062468e932bee953a.

Change-Id: I8cdd8fa49ca4928dd8165d8787f476d34233e4b1
Reviewed-on: http://review.couchbase.org/40790
Tested-by: buildbot <build@couchbase.com>
Reviewed-by: Sarath Lakshman <sarath@couchbase.com>
Reviewed-by: Nimish Gupta <nimish@couchbase.com>

show more ...

c9196b7826-Aug-2014 Volker Mische <vmx@couchbase.com>

MB-12048: Make 3.0 mapreduce view group signature backwards compatible

The view engine uses a list of view records (#set_view{}) to calculate
the signature of a view group. Whenever this

MB-12048: Make 3.0 mapreduce view group signature backwards compatible

The view engine uses a list of view records (#set_view{}) to calculate
the signature of a view group. Whenever this record is modified, the
signature will change.

In 3.0 the #set_view{} record changed in order to accommodate the
spatial views as well. This change lead to a different group signature
even if the design document didn't change. This rendered the views
created by Couchbase 2.x unusable. Those views would've been removed
and the indexing would've been started from scratch.

With this change the view groups in Couchbase 3.0 will have the same
signatures as they would have in 2.x.

NOTE: With this change the signatures of view groups change, this
means that all indexes created with a Couchbase 3.0 prior to this
commit will be rebuilt.

Change-Id: I901f6044cde5848eaaf18f63234e339cf3c80c82
Reviewed-on: http://review.couchbase.org/40915
Reviewed-by: Sriram Melkote <siri@couchbase.com>
Reviewed-by: Sarath Lakshman <sarath@couchbase.com>
Reviewed-by: Volker Mische <volker.mische@gmail.com>
Tested-by: buildbot <build@couchbase.com>

show more ...

708ba24326-Aug-2014 Volker Mische <vmx@couchbase.com>

MB-12048: Upgrade mapreduce headers from 2.x to 3.0

The mapreduce index header change in Couchbase 3.0 due to the introduction
of DCP. The header now also contains the partition versions

MB-12048: Upgrade mapreduce headers from 2.x to 3.0

The mapreduce index header change in Couchbase 3.0 due to the introduction
of DCP. The header now also contains the partition versions. As 2.x
headers don't have that information, `nil` is stored as a placeholder
whenever a 2.x header is parsed.

When the view group is created and it contains such a placeholder, the
partition versions are requested from the server. From then on the view
engine can proceed as usual. The next time the header is written to disk,
it will contain the correct information.

Change-Id: I2b3f1068613dd4a814b7479b4a36cb48dd6eb19e
Reviewed-on: http://review.couchbase.org/40914
Reviewed-by: Volker Mische <volker.mische@gmail.com>
Tested-by: buildbot <build@couchbase.com>
Reviewed-by: Sarath Lakshman <sarath@couchbase.com>
Reviewed-by: Sriram Melkote <siri@couchbase.com>

show more ...

b75c1fd218-Aug-2014 Sarath Lakshman <sarathlakshman@slynux.com>

MB-10921 Add a test for fdleak during queries for views with a reducer

Change-Id: I23c3e8c1861e05c5154840e226132baa775c87c1
Reviewed-on: http://review.couchbase.org/40688
Reviewed-by

MB-10921 Add a test for fdleak during queries for views with a reducer

Change-Id: I23c3e8c1861e05c5154840e226132baa775c87c1
Reviewed-on: http://review.couchbase.org/40688
Reviewed-by: Volker Mische <volker.mische@gmail.com>
Reviewed-by: Sriram Melkote <siri@couchbase.com>
Reviewed-by: Sarath Lakshman <sarath@couchbase.com>
Tested-by: buildbot <build@couchbase.com>

show more ...

eaf6756016-Aug-2014 Sarath Lakshman <sarathlakshman@slynux.com>

MB-10921 Release fds properly for views with reduce queries

View group file descriptors are reference counted by the number of callers.
When refcount becomes zero, fd is internally close

MB-10921 Release fds properly for views with reduce queries

View group file descriptors are reference counted by the number of callers.
When refcount becomes zero, fd is internally closed by the refcounter.

Interested callers acquire view_group using request_group() and refcount for
the fd is autoincremented. The caller who has acquired the view_group should
call release_group() explicitly to decrement the refcount or the caller process
should die to get refcount decremented.

For reduce enabled views, fd reference count is not decremented correctly
after the query path discards that fd. The http server implementation spawns
one worker process per connection. If a connection is reused, queries served
through that connection is processed by the same erlang process.
A missing fd decrement after use of requested group causes fd leaks in
the case of keep-alive connections used for queries.

The leak can be reproduced by using the following steps:
1. Create a view with reduce function and build the view with sufficient data
2. Send the following http request through netcat and keep the netcat open to
simulate reuse of connection.

$ nc localhost 8092
GET /default/_design/test/_view/test?stale=update_after HTTP/1.1

3. Now trigger manual compaction
4. $ echo beam | xargs -n1 pgrep | xargs -n1 -r -- lsof -n -p | grep deleted
beam.smp 27922 ubuntu 41r REG 202,1 2054213 167136 /home/ubuntu/couchbase-2.5/ns_server/data/n_0/data/.delete/5d79134a257d5866532ddef4d9827780 (deleted)

Change-Id: I20a74202587198da46b81e2e722dcbf9821d7b08
Reviewed-on: http://review.couchbase.org/40679
Reviewed-by: Sarath Lakshman <sarath@couchbase.com>
Tested-by: buildbot <build@couchbase.com>
Reviewed-by: Volker Mische <volker.mische@gmail.com>
Reviewed-by: Sriram Melkote <siri@couchbase.com>

show more ...

ce07551a14-Aug-2014 Nimish Gupta <nimish@couchbase.com>

MB-11919 Log sequence number difference in indexing

Due to MB-11589, we are suspecting that view indexer has to do more
work. Added a message to log how many extra mutations we are getti

MB-11919 Log sequence number difference in indexing

Due to MB-11589, we are suspecting that view indexer has to do more
work. Added a message to log how many extra mutations we are getting
in indexing during rebalance.

Change-Id: Ibd6fb2e43d384ecfe98174fce5f296159aaefe42
Reviewed-on: http://review.couchbase.org/40617
Tested-by: Nimish Gupta <nimish@couchbase.com>
Reviewed-by: Sarath Lakshman <sarath@couchbase.com>

show more ...

6e19fa4014-Aug-2014 Sarath Lakshman <sarathlakshman@slynux.com>

MB-11947 Use cached seqs during any error on get_seqs() call

Change-Id: I3baa5433d51b18663332d6e968093dd3a06c8564
Reviewed-on: http://review.couchbase.org/40618
Reviewed-by: Sarath L

MB-11947 Use cached seqs during any error on get_seqs() call

Change-Id: I3baa5433d51b18663332d6e968093dd3a06c8564
Reviewed-on: http://review.couchbase.org/40618
Reviewed-by: Sarath Lakshman <sarath@couchbase.com>
Reviewed-by: Volker Mische <volker.mische@gmail.com>
Tested-by: buildbot <build@couchbase.com>

show more ...

93100a0014-Aug-2014 Volker Mische <volker.mische@gmail.com>

Revert "MB-11917: Bump reductions before the NIF call"

It lead to utilisation of a single core only.

This reverts commit 4b467172df476b42c8acca985492bb0abc484d83.

Change-Id

Revert "MB-11917: Bump reductions before the NIF call"

It lead to utilisation of a single core only.

This reverts commit 4b467172df476b42c8acca985492bb0abc484d83.

Change-Id: I024d9006127318c0dd8153b4aeda1e06220b5a26
Reviewed-on: http://review.couchbase.org/40616
Reviewed-by: Volker Mische <volker.mische@gmail.com>
Tested-by: buildbot <build@couchbase.com>
Reviewed-by: Sarath Lakshman <sarath@couchbase.com>

show more ...

4b46717213-Aug-2014 Volker Mische <vmx@couchbase.com>

MB-11917: Bump reductions before the NIF call

The mapreduce NIF probably screws up the scheduler. Hence aggressively
increase the reduction count. This should prevent the schedulers from

MB-11917: Bump reductions before the NIF call

The mapreduce NIF probably screws up the scheduler. Hence aggressively
increase the reduction count. This should prevent the schedulers from
blocking.

The idea comes from the #erlang IRC channel, the implementation is
similar to the one from Basho's eleveldb.

Change-Id: I330b8466a1b559837b2c787c13d2130589f7193b
Reviewed-on: http://review.couchbase.org/40591
Reviewed-by: Aliaksey Kandratsenka <alkondratenko@gmail.com>
Tested-by: Aliaksey Kandratsenka <alkondratenko@gmail.com>

show more ...

ac737dab13-Aug-2014 Sarath Lakshman <sarathlakshman@slynux.com>

Update indexed seqnos list correctly for incremental update

EP-Engine may send more mutations than requested endseqnos through DCP
when a stream is requested. We process all the mutation

Update indexed seqnos list correctly for incremental update

EP-Engine may send more mutations than requested endseqnos through DCP
when a stream is requested. We process all the mutations that arrived
from the DCP stream and update the index. But, the metadata list that
maintains the last indexed seqnos is incorrectly updated to the
requested endseqno for each partitions rather than seqno that we
received from the DCP stream. This could result in view engine
to request same data multiple times and process it redundantly.

Change-Id: I8371eda428f39fccf30948854a9b82c54f14a7ae
Reviewed-on: http://review.couchbase.org/40574
Reviewed-by: Sarath Lakshman <sarath@couchbase.com>
Tested-by: buildbot <build@couchbase.com>
Reviewed-by: Volker Mische <volker.mische@gmail.com>
Reviewed-by: Nimish Gupta <nimish@couchbase.com>

show more ...

bdd4b91012-Aug-2014 Sarath Lakshman <sarathlakshman@slynux.com>

MB-11843 Use cached seqnos if get_seqs() fail due to connection close

During a node is rebalanced out, the ns_server takes out the partitions
to another node and finally performs a bucke

MB-11843 Use cached seqnos if get_seqs() fail due to connection close

During a node is rebalanced out, the ns_server takes out the partitions
to another node and finally performs a bucket delete. When a bucket is
deleted, EP-Engine closes all dcp connections. During the connection
close occured, if the view_group is requesting for seqnos, it will
fail with dcp_conn_closed error. Retrying to request seqnos after trying
to reconnect socket may not succeed since the bucket is deleted. We
should handle this error gracefully by returning previously cached
seqnos.

Change-Id: Idc24061369f1c29269e482884a3dad169c6a0403
Reviewed-on: http://review.couchbase.org/40404
Reviewed-by: Sarath Lakshman <sarath@couchbase.com>
Tested-by: buildbot <build@couchbase.com>
Reviewed-by: Volker Mische <volker.mische@gmail.com>

show more ...

4015a33408-Aug-2014 Sarath Lakshman <sarathlakshman@slynux.com>

Refactor seqs cache implementation

The seqs cache is currently part of view_group state. The cache
will be later moved to its on module or inside the dcp_client module.
The cache nee

Refactor seqs cache implementation

The seqs cache is currently part of view_group state. The cache
will be later moved to its on module or inside the dcp_client module.
The cache needs to be updated everytime when any get_seqs() results
are processed inside view_group to avoid duplicate get_seqs() calls.

Refactored seqs_cache to make it separated out from process state variable.
Any function should be able to update the cache without having reference
to state variable. Hence, moved the location of seqs_cache to process table.

Change-Id: Ic3038dd7d7fd91e15c09f11d15654582f2ee23b0
Reviewed-on: http://review.couchbase.org/40407
Reviewed-by: Sarath Lakshman <sarath@couchbase.com>
Reviewed-by: Volker Mische <volker.mische@gmail.com>
Tested-by: buildbot <build@couchbase.com>

show more ...

12345678910>>...158