History log of /4.0.0/forestdb/src/docio.cc (Results 1 - 25 of 68)
Revision (<<< Hide revision tags) (Show revision tags >>>) Date Author Comments
Revision tags: v1.2, v1.1, v1.0
# 7171f367 29-May-2015 Sundar Sridharan <sundar.sridharan@gmail.com>

MB-15183: allow libaio key-meta only batch reads

Change-Id: I3ede2b6fe16769959379c0c647316237c4aa8059


# c6c3d274 20-May-2015 Chiyoung Seo <chiyoung.seo@gmail.com>

MB-14060 Use async I/O to move data blocks to a new file during the compaction

This change uses libaio in Linux to read data blocks from the old file
and move them to the new file during

MB-14060 Use async I/O to move data blocks to a new file during the compaction

This change uses libaio in Linux to read data blocks from the old file
and move them to the new file during the compaction.

We also plan to add the asynchronous I/O support for other OSs
(e.g., Windows, OSx).

Change-Id: I2ba7462291b17171fde06fe5887db8cd0cf76c39

show more ...


# 0ad09ae7 27-Apr-2015 Tommie McAfee <tommie@couchbase.com>

fix compile error when DOCIO_BLOCK_ALIGN

sherlock

Change-Id: If1a9efb62355fdf8df9091805996959078fb41be


# ccf0294f 24-Apr-2015 Chiyoung Seo <chiyoung.seo@gmail.com>

Remove the WAL recovery module from a partially compacted file.

With a new compaction method, we don't need to restore the WAL
documents from the partially compacted file.

Chang

Remove the WAL recovery module from a partially compacted file.

With a new compaction method, we don't need to restore the WAL
documents from the partially compacted file.

Change-Id: I0f3f7af24d8354f027e998b1bce424994464db1d

show more ...


# c279f70e 13-Apr-2015 Chiyoung Seo <chiyoung.seo@gmail.com>

Fix compiler warnings caused by number formattings.

Change-Id: I9d0314959d41edf9058457a688904daeaacb962b


# 704daaa2 07-Apr-2015 Chiyoung Seo <chiyoung.seo@gmail.com>

Add more loggings to erroneous cases in doc_io operations.

Change-Id: Ia47d8427a7df4ab0d2affb7531dbd1e2d0d13ddd


# 5aa14abc 11-Apr-2015 Sundar Sridharan <sundar.sridharan@gmail.com>

Compiler warnings and minor bug fixes

Change-Id: I753118f2f79760d43b421e63aca512449da89574


# 6ef65b54 01-Apr-2015 Jung-Sang Ahn <jungsang.ahn@gmail.com>

MB-14060 Insert new docs by normal writer during compaction into old file

- New docs inserted by normal writer during compaction are stored in
the old file.

- After the first ph

MB-14060 Insert new docs by normal writer during compaction into old file

- New docs inserted by normal writer during compaction are stored in
the old file.

- After the first phase of compaction (moving all docs in HB+trie at
the time when the compaction begins) is done, the second phase of
compaction (moving all delta docs inserted during the first phase)
is performed.

- The second phase is repeated until there is no more delta.

- Now 'handle->new_file' is never set and not used at all. Those
unused codes will be removed in a separate refactoring commit.

Change-Id: I034c074767264a245edcb8b89182a49086e99f02

show more ...


# b6be7a1d 01-Apr-2015 Sundar Sridharan <sundar.sridharan@gmail.com>

fdb_assert() to trace & dump all forestdb handles if SIGABRT

cmake -D_TRACK_HANDLES=1 /path/to/forestdb
to turn on handle track and dump on assert
This change will help track open fi

fdb_assert() to trace & dump all forestdb handles if SIGABRT

cmake -D_TRACK_HANDLES=1 /path/to/forestdb
to turn on handle track and dump on assert
This change will help track open file handles and dump their content
on asserts() only if the macro is enabled at compile-time
To help debug golang environments where there are no useful symbols
available in core dumps
Change-Id: I7ce97ed713452c3dbe2c7eb2925d913a2c0c902b

show more ...


# a6fb601e 10-Mar-2015 Jung-Sang Ahn <jungsang.ahn@gmail.com>

MB-13841 Adjust offset to block marker during compaction

- During the compaction, if the current offset points to the block
marker, then the document is successfully read from the file b

MB-13841 Adjust offset to block marker during compaction

- During the compaction, if the current offset points to the block
marker, then the document is successfully read from the file but
the offset itself differs to the offset returned from HB+trie. We
need to adjust this 1-byte error.

- If a false positive on the checksum of doc.length occurs on an
abnormal document whose TXN_COMMIITTED flag is accidentally set,
docio_read_doc() doesn't return failure, and the right next document
is not correctly moved into the new file. Added more rigorous
check routine.

Change-Id: I78a1f011782288abc8fbe1a8de5cfc03d50ebb9a

show more ...


# 0ae9b637 10-Mar-2015 Chiyoung Seo <chiyoung.seo@gmail.com>

Don't need to free the decompression buffer if compression is not enabled.

Change-Id: I801ae43e064c0eed1a42603539754c7d3c57dfb6


# 953ee6bd 10-Mar-2015 Chiyoung Seo <chiyoung.seo@gmail.com>

Free a compression buffer memory if a compress operation fails.

Change-Id: Ia8a7d3efcd6835648f8d20ce622f95be5651f520


# 69da2acb 26-Feb-2015 Chiyoung Seo <chiyoung.seo@gmail.com>

MB-13633 Don't allocate memory for zero-length meta data and body

Some OSs(e.g., Windows) complain memory allocation with zero-length.

Change-Id: Idaee396320790f5da3e31ea7dfc77e828c

MB-13633 Don't allocate memory for zero-length meta data and body

Some OSs(e.g., Windows) complain memory allocation with zero-length.

Change-Id: Idaee396320790f5da3e31ea7dfc77e828c624a0f

show more ...


# 7b819201 10-Feb-2015 Jung-Sang Ahn <jungsang.ahn@gmail.com>

Free doc.meta if metalen is zero

- If metadata doesn't exist, we don't need to return memory segment
for metadata.

- docio_read_doc() already does this; it was missing for
d

Free doc.meta if metalen is zero

- If metadata doesn't exist, we don't need to return memory segment
for metadata.

- docio_read_doc() already does this; it was missing for
docio_read_doc_key_meta().

Change-Id: Idc0a3d4fb30e21436fb183d30c5f49f47cd48032

show more ...


# f80ddf4d 22-Jan-2015 Chiyoung Seo <chiyoung.seo@gmail.com>

Make internal functions static if their scopes are not global.

Change-Id: Ic390a59e76b99c86c29a3fefc76a0975becdccd3


# e4da0646 13-Jan-2015 Chiyoung Seo <chiyoung.seo@gmail.com>

MB-12923 Exclude unreachable functions or code paths from lcov coverage

Change-Id: I877f1aa917ad7f11911895d0b187f9271e46866f


# 3c6d74b4 02-Jan-2015 Sundar Sridharan <sundar.sridharan@gmail.com>

MB-12612: handle read failures, CRC failures

Propogate CRC checksum failures and read failures to api
Added anomaly test for read at open and CRC failure at fdb_get
Change-Id: I98dbc

MB-12612: handle read failures, CRC failures

Propogate CRC checksum failures and read failures to api
Added anomaly test for read at open and CRC failure at fdb_get
Change-Id: I98dbc8d48cadb6f95632e81b32c4754a8361fc2a

show more ...


# 84f94aa1 16-Dec-2014 Sundar Sridharan <sundar.sridharan@gmail.com>

MB-12613: clang analyzer fixes for null dereference, dead store etc

Change-Id: I71baac9cb49cca7473289dedfbc1c00f08fbc728


# cb0f0747 04-Dec-2014 Sundar Sridharan <sundar.sridharan@gmail.com>

Handle Disk Write errors gracefully

Propogate filemgr_* write and read errors upwards
to callers so disk errors do not cause asserts.

Change-Id: Iae9991f16d08595f73fa200004cdde8

Handle Disk Write errors gracefully

Propogate filemgr_* write and read errors upwards
to callers so disk errors do not cause asserts.

Change-Id: Iae9991f16d08595f73fa200004cdde8f2137ad25

show more ...


# a40256a8 04-Dec-2014 Chiyoung Seo <chiyoung.seo@gmail.com>

Revert "MB-12612 Anomalous Test Framework + Graceful DiskOutOfSpace handling"

This reverts commit 69488222297a65d82d6faca806111221db80a5ce.


# 69488222 04-Dec-2014 Sundar Sridharan <sundar.sridharan@gmail.com>

MB-12612 Anomalous Test Framework + Graceful DiskOutOfSpace handling

Fix disk-out of space error handling by not asserting in forestdb layer
but rather propogating error to caller
Re

MB-12612 Anomalous Test Framework + Graceful DiskOutOfSpace handling

Fix disk-out of space error handling by not asserting in forestdb layer
but rather propogating error to caller
Redirect filemgr_ops to filemgr_ops_anomalous to create new anomalous
test framework infrastructure where system calls can fail selectively
based on the test suite.
+add new basic write failure anomaly tests
Change-Id: I2375492da5d9e5e0a378fb898adb3986895552c0

show more ...


# d32401da 05-Sep-2014 Jung-Sang Ahn <jungsang.ahn@gmail.com>

MB-11071 Support multiple KV instances

- Add three new main operations: open (create), close, remove of KV
instance in a DB file handle.

- All other operations (get, set, rollba

MB-11071 Support multiple KV instances

- Add three new main operations: open (create), close, remove of KV
instance in a DB file handle.

- All other operations (get, set, rollback, snapshot, etc.) are shared
with the original APIs.

- Same as snapshot, KV instance uses the fdb_handle structure, but
commit and compaction can be invoked only using the DB file handle.

Change-Id: Iad571745c57053d46130be584c5213e98baa9b9f

show more ...


# 20a71dce 09-Sep-2014 Chiyoung Seo <chiyoung.seo@gmail.com>

Free memory segments allocated in fdb_get_byoffset before returning an error

Change-Id: I079a18ddd03c7829ce8020a6bc01350f7383aecb


# a9e1b0e8 26-Aug-2014 Jung-Sang Ahn <jungsang.ahn@gmail.com>

Fix a bug in appending a large document

- When a document that is longer than at least 3 blocks (i.e., 12 KB)
is appending, block markers for the middle blocks are overwritten with
a

Fix a bug in appending a large document

- When a document that is longer than at least 3 blocks (i.e., 12 KB)
is appending, block markers for the middle blocks are overwritten with
an arbitrary data due to use of filemgr_write.

show more ...


# 21dda1b2 18-Jul-2014 Jung-Sang Ahn <jungsang.ahn@gmail.com>

MB-11747 Support long keys

- FDB_MAX_KEYLEN is changed to 3840, which is calculated as
'blocksize(4KB) - 256(reserved headroom)'.
- Fix a bug that doesn't update block->sb_no after s

MB-11747 Support long keys

- FDB_MAX_KEYLEN is changed to 3840, which is calculated as
'blocksize(4KB) - 256(reserved headroom)'.
- Fix a bug that doesn't update block->sb_no after sub-block is
enlarged.
- Add a unit test using very long keys and long common prefixes.

Change-Id: Ifb642b6b754b2b0bca2f67bcbf5c2eac369e8da3

show more ...


123