History log of /5.5.2/forestdb/tools/forestdb_dump.cc (Results 1 - 25 of 30)
Revision (<<< Hide revision tags) (Show revision tags >>>) Date Author Comments
# 664c0dd5 05-Jan-2017 Sundar Sridharan <sundar.sridharan@gmail.com>

[BP] MB-22046: forestdb_dump --key must work on deleted keys too

Don't dump full header if a specific key or specific kv store
name is given. This is to aid testing code which is just

[BP] MB-22046: forestdb_dump --key must work on deleted keys too

Don't dump full header if a specific key or specific kv store
name is given. This is to aid testing code which is just
examining if a given key made it to the storage end.
Search by meta if search by key fails so that deleted keys
can be point searched too.

Change-Id: I460f663d5d7eab3ac89f814c12fb1be3c78c11ed
Reviewed-on: http://review.couchbase.org/79133
Reviewed-by: Jung-Sang Ahn <jungsang.ahn@gmail.com>
Tested-by: Sundararaman Sridharan <sundar@couchbase.com>

show more ...


Revision tags: v1.2, v1.1, v1.0
# ce30d60a 17-Feb-2016 Chiyoung Seo <chiyoung.seo@gmail.com>

MB-17670 Improve error handling in doc I/O and its callers

This change adapts the return type of doc_io_read APIs to return appropriate
error codes to the callers, so that the callers ca

MB-17670 Improve error handling in doc I/O and its callers

This change adapts the return type of doc_io_read APIs to return appropriate
error codes to the callers, so that the callers can handle those errors
properly and return them to the clients.

Change-Id: I0665fe47150e0d690db7ffc38a202c70a422cd07

show more ...


# 34e10f85 20-Feb-2016 Sundar Sridharan <sundar.sridharan@gmail.com>

MB-14710: MVCC WAL for Fast & Cheap Snapshots, Iterators

wal_items are shared with writer, current & all future snapshots
until wal_flush.
Mutations are inserted into KV Store's late

MB-14710: MVCC WAL for Fast & Cheap Snapshots, Iterators

wal_items are shared with writer, current & all future snapshots
until wal_flush.
Mutations are inserted into KV Store's latest mutable snapshot.
When snapshot_open is called the latest mutable snapshot of KVS
is marked as immutable and returned/cloned.
Stable iterations do merge-sort over all WAL shards but
return only the wal_item that was valid at time of snapshot.
wal_flush lazily cleans up items of closed snapshots and prevents
future snapshots from accessing items created before the flush.
Iterators simplified to be symmetric & reactive instead of proactive

Change-Id: I1a42758e28d522031f595b15ec580bc837382dd9

show more ...


# f7a5b7a7 15-Feb-2016 Chiyoung Seo <chiyoung.seo@gmail.com>

Add a new API to return the version of a given ForestDB file

This change adds the new API fdb_get_file_version to return the string
representation of a ForestDB file version.

In

Add a new API to return the version of a given ForestDB file

This change adds the new API fdb_get_file_version to return the string
representation of a ForestDB file version.

In addition, this changes adds --header-only option to forestdb_dump tool
to print out the latest database header info including a file version.

$ ./forestdb_dump --header-only path_to_database_file

DB header info:
BID: 113 (0x71, byte offset: 462848)
DB header length: 88 bytes
DB header revision number: 5
DB file version: ForestDB v1.x format
...

Change-Id: I51e90bfb9aca3ae6c63db1292882f578f7e07cf0

show more ...


# c6c3d274 20-May-2015 Chiyoung Seo <chiyoung.seo@gmail.com>

MB-14060 Use async I/O to move data blocks to a new file during the compaction

This change uses libaio in Linux to read data blocks from the old file
and move them to the new file during

MB-14060 Use async I/O to move data blocks to a new file during the compaction

This change uses libaio in Linux to read data blocks from the old file
and move them to the new file during the compaction.

We also plan to add the asynchronous I/O support for other OSs
(e.g., Windows, OSx).

Change-Id: I2ba7462291b17171fde06fe5887db8cd0cf76c39

show more ...


# ebae7333 14-Apr-2015 Sundar Sridharan <sundar.sridharan@gmail.com>

more debian compiler warnings fixed

Change-Id: I54bc79fe9a3a81a24855792f89417b450d4d49cf


# 1f60a5c9 08-Apr-2015 Sundar Sridharan <sundar.sridharan@gmail.com>

MB-13701: Add tool forestdb_hexamine to debug fdb files

This tool will read all blocks into memory and endian_decode
DB header blocks for easy debugging of forestdb files in gdb.
Cha

MB-13701: Add tool forestdb_hexamine to debug fdb files

This tool will read all blocks into memory and endian_decode
DB header blocks for easy debugging of forestdb files in gdb.
Change-Id: Ic84bc559bfc8171450ac5b228fd264dea7a4682b

show more ...


# 32a9d105 09-Mar-2015 Jung-Sang Ahn <jungsang.ahn@gmail.com>

MB-13814 Provide sequence number even for DB without seq-tree

Change-Id: I5bf20183dd855084c40424807e6ffce93f2c80b5


# 9c8edd43 22-Jan-2015 Chiyoung Seo <chiyoung.seo@gmail.com>

Reset fdb_doc pointer to NULL in forestdb_dump tool

As we allow the client to reuse an fdb_doc instance for fdb_iterator_get API,
We need to reset fdb_doc pointer to NULL if it gets free

Reset fdb_doc pointer to NULL in forestdb_dump tool

As we allow the client to reuse an fdb_doc instance for fdb_iterator_get API,
We need to reset fdb_doc pointer to NULL if it gets freed.

Change-Id: Icce7319a3852a479fa623ab9ec36e8bc7a41ffa5

show more ...


# 56f1f4b8 16-Dec-2014 Sundar Sridharan <sundar.sridharan@gmail.com>

MB-12854: Support cloning of in-memory snapshots

Rewind DB header to that of incoming handle during _open()
if cloning from an existing snapshot.
Re-use existing snapshot's AVL tree,

MB-12854: Support cloning of in-memory snapshots

Rewind DB header to that of incoming handle during _open()
if cloning from an existing snapshot.
Re-use existing snapshot's AVL tree, with reference counting,
so no additional memory is used and wal restoration is avoided.
Change-Id: Ib60a9bd3efe3c2210eead924d02ac80473fd8185

show more ...


# bf703f63 10-Dec-2014 Sundar Sridharan <sundar.sridharan@gmail.com>

MB-12465: New Iteration APIs & Semantics

1) fdb_iterator_next and fdb_iterator_prev only re-position cursor.
2) fdb_iterator_get and fdb_iterator_get_metaonly retrieve items
at the c

MB-12465: New Iteration APIs & Semantics

1) fdb_iterator_next and fdb_iterator_prev only re-position cursor.
2) fdb_iterator_get and fdb_iterator_get_metaonly retrieve items
at the cursor.
3) fdb_iterator_seek_to_min positions the cursor at the smallest key.
4) fdb_iterator_seek_to_max() positions the cursor at the largest key.
5) fdb_iterator_seek() accepts a direction to indicate which key must
be selected if the seek key is not present.
6) Reduced memory usage for the iterator by use of unions where possible.
7) Simplified TEST_CMP for memcmp to report errors in test cases.
For example,
fdb_doc *rdoc;
fdb_iterator_init(...);
do {
status = fdb_iterator_get(iterator, &rdoc);
...
fdb_doc_free(rdoc);
} while (fdb_iterator_next(iterator) != FDB_RESULT_ITERATOR_FAIL);
status = fdb_iterator_seek_to_min(iterator);
status = fdb_iterator_get(iterator, &rdoc);
...
fdb_doc_free(rdoc);
...
status = fdb_iterator_seek(iterator, seek_key, seek_keylen, direction);
status = fdb_iterator_seek_to_max(iterator);
status = fdb_iterator_get(iterator, &rdoc);
...
fdb_doc_free(rdoc);
Change-Id: I3818f39316ecaa8cbc2d5bc37e421efe6cb36101

show more ...


# c99459d2 09-Dec-2014 Sundar Sridharan <sundar.sridharan@gmail.com>

Replace wal_result with fdb_status for more specific errors

Change-Id: I0d31ad7b579dc99e928f7769d58d0ca239c50fba


# 13fd7d20 13-Nov-2014 Jung-Sang Ahn <jungsang.ahn@gmail.com>

MB-12573 Adapt forestdb_dump tool to be compatible with multi KVS mode

- All KV store info are printed in the DB header section.

- Added one more option: --kvs [KV store name]. If t

MB-12573 Adapt forestdb_dump tool to be compatible with multi KVS mode

- All KV store info are printed in the DB header section.

- Added one more option: --kvs [KV store name]. If this option is passed,
only documents belonging to the specified KV store are displayed.

Change-Id: I64dac7022d1fe8abda2f2c826491cf7e3fe3dcf1

show more ...


# 4dc52e2d 12-Nov-2014 Trond Norbye <trond.norbye@gmail.com>

Remove unused variables (-Wunused-variable)

Change-Id: I9f63f438848d61de3ca85b4e88a900c3ae5e6ba6


# e6e251ad 08-Nov-2014 Sundar Sridharan <sundar.sridharan@gmail.com>

Make file and KV store distinction clear in public APIs.

The following APIs and structures are renamed as follows:

APIs:
fdb_get_dbinfo --> fdb_get_file_info
fdb_get_seqnum

Make file and KV store distinction clear in public APIs.

The following APIs and structures are renamed as follows:

APIs:
fdb_get_dbinfo --> fdb_get_file_info
fdb_get_seqnum --> fdb_get_kvs_seqnum

Structure:
fdb_handle --> fdb_kvs_handle
fdb_info --> fdb_file_info

Change-Id: Ia822aa1f61a087feec4e86f07cdc9fa855911191

show more ...


# 8ba0b46d 07-Nov-2014 Trond Norbye <trond.norbye@gmail.com>

Remove compile warnings: Warning:unused-label

Change-Id: I737c3d30d5970d169c51d11a8d9e2eea95fd02ea


# d32401da 05-Sep-2014 Jung-Sang Ahn <jungsang.ahn@gmail.com>

MB-11071 Support multiple KV instances

- Add three new main operations: open (create), close, remove of KV
instance in a DB file handle.

- All other operations (get, set, rollba

MB-11071 Support multiple KV instances

- Add three new main operations: open (create), close, remove of KV
instance in a DB file handle.

- All other operations (get, set, rollback, snapshot, etc.) are shared
with the original APIs.

- Same as snapshot, KV instance uses the fdb_handle structure, but
commit and compaction can be invoked only using the DB file handle.

Change-Id: Iad571745c57053d46130be584c5213e98baa9b9f

show more ...


# 46ead661 14-Oct-2014 Chris Hillery <ceej@couchbase.com>

Various changes to get ForestDB compiling as part of Sherlock build

Change-Id: I9c5397b2a8f55c9a2d30c85cb4cf4da1bfa59a21


# ec43fd6c 01-Aug-2014 Jung-Sang Ahn <jungsang.ahn@gmail.com>

Fix warnings about 64-bit hex format on Ubuntu 14.04

- Add `_X64` macro for 64-bit hex printf format.


# 0cfeb863 28-Jul-2014 Jung-Sang Ahn <jungsang.ahn@gmail.com>

Respect the existing sequence tree option of the existing DB files

- Sequence tree option is only used for creating a new database.
- When opening an existing database, sequence tree opt

Respect the existing sequence tree option of the existing DB files

- Sequence tree option is only used for creating a new database.
- When opening an existing database, sequence tree option is
automatically adjusted to the old settings.

show more ...


# 6a0e8eac 10-Jul-2014 Chiyoung Seo <chiyoung.seo@gmail.com>

Fix the compile warning on type format.

Change-Id: I7474cda7cfbbb89e9a2762ec786b2b539f84a713


# 3c2f0409 10-Jul-2014 Jung-Sang Ahn <jungsang.ahn@gmail.com>

Improve fdb_dump tool to print BID info in more detail

- Print sub-block info for root node of HB+trie and B+tree.
- Do not display the raw BID value for non-existing block.

Cha

Improve fdb_dump tool to print BID info in more detail

- Print sub-block info for root node of HB+trie and B+tree.
- Do not display the raw BID value for non-existing block.

Change-Id: I8f04ed6d118218b0cf31e41098a3c3cc04a1e8a2

show more ...


# 4f2ebc0a 08-Jul-2014 Jung-Sang Ahn <jungsang.ahn@gmail.com>

MB-11056 Adler32 checksum support

- Adler32 can replace CRC32 using a preprocessor option
'__CHECKSUM_ADLER32' defined in option.h (disabled by default).

- Using O2 optimization

MB-11056 Adler32 checksum support

- Adler32 can replace CRC32 using a preprocessor option
'__CHECKSUM_ADLER32' defined in option.h (disabled by default).

- Using O2 optimization option, Adler32 is about 1.5x and +100x
faster than CRC32 on MacBook Pro (i7 2.3GHz, 4 cores, 8 threads) for
calculating checksum of 1GB and 1KB data respectively. Compared to
CRC32 (slicing 8 bytes), Adler32 becomes much faster as the size of
data gets smaller (may be due to CPU cache fetching issues).

- However, the improvement is very marginal in ForestDB workload
(using synchronous commit) because the overall performance is bounded
by Disk I/O.

show more ...


# 706e66fd 03-Jul-2014 Chiyoung Seo <chiyoung.seo@gmail.com>

Don't access the HB+ Trie instance directly from forestdb_dump tool

If a custom compare function is used with variable-length keys,
then a regular B+ tree is used instead of HB+ Trie.

Don't access the HB+ Trie instance directly from forestdb_dump tool

If a custom compare function is used with variable-length keys,
then a regular B+ tree is used instead of HB+ Trie.
Therefore, forestdb_dump tool shouldn't access the HB+ Trie
instance directly.

If we really need to support dumping WAL items followed by the
main index entries, then we should adapt forestdb_dump tool
accordingly.

Change-Id: I6dcec9b85501464e8e2e32bb8a918542e2498b3f

show more ...


# 921f322d 03-Jul-2014 Jung-Sang Ahn <jungsang.ahn@gmail.com>

Fix memory leak in forestdb_dump

- key, meta and body in docio object were not freed at the end of
print_doc function.
- Add internal memleak tool commands for checking memory leak.

Fix memory leak in forestdb_dump

- key, meta and body in docio object were not freed at the end of
print_doc function.
- Add internal memleak tool commands for checking memory leak.

Change-Id: I683f4f3922eb6223dba9b7b4890a822524d88f1c

show more ...


12