Updated project files and tests #19

enury · 2015-02-11T16:57:24Z

Prevented re-tokenization occuring in Collation.tokens
Added detection of pretokenized json
Merged collate_pretokenized_json with collate function

Update create_from_json method.

Update tokens property of Collation.

Added pretokenized keyword argument in function collate, and created new function get_tokenized_at. Deleted function collate_pretokenized_json. Added option of vertical layout also for json output.

Replaced Collation.tokens property with an attribute combined_tokens.

Replaced Collation.tokens property with combined_tokens attribute.

Added auto-detection of pretokenized json.

Added exception handling in Witness class.

Added layout for tokenized alignment table Attempt at creating the tokenized alignment table when tokens are joined into segments.

use next(generator) instead of generator.next()

enury added 30 commits February 9, 2015 17:49

Update core_functions.py

1413301

Update create_from_json method.

Create json-test1

6842ca8

Create json-test2.json

5d12d08

Delete json-test1

aad18be

Create json-test1.json

bebc856

Update json-test1.json

f68f4cc

Update json-test2.json

b0fa0b4

Update core_functions.py

ed8c8e0

Update tokens property of Collation.

Update core_functions.py

babd89c

Update core_functions.py

5b5ab04

Update Witness class in core_classes.py

8bc6bec

Update core_functions.py

eaa7a88

Added pretokenized keyword argument in function collate, and created new function get_tokenized_at. Deleted function collate_pretokenized_json. Added option of vertical layout also for json output.

Update __init__.py

6672e52

Update core_functions.py

070f825

Update core_functions.py

42fb5eb

Replaced Collation.tokens property with an attribute combined_tokens.

Update suffix_based_scorer.py

3392a42

Replaced Collation.tokens property with combined_tokens attribute.

Update core_functions.py

58a3a5e

Added auto-detection of pretokenized json.

Update core_classes.py

b5e2bad

Added exception handling in Witness class.

Create json-test3.json

7fc92eb

Update core_functions.py

b7beb23

Update core_functions.py

a5bc15b

Update core_functions.py

42de8b1

Added layout for tokenized alignment table Attempt at creating the tokenized alignment table when tokens are joined into segments.

Create test_token_class.py

9aeaebb

Create test_witness_class.py

13af6dd

Create test_collation_class.py

87675aa

Create test_collate_outputs.py

8b9b0ec

Update core_classes.py

42546cf

Update test_collatex_block_witnesses.py

c2923d5

Update test_near_matching_pretokenized.py

2914b6b

Update test_witness_tokens.py

977b0fa

enury added 4 commits March 24, 2015 17:54

Update test_collatex_block_witnesses.py

65a18f8

Update test_collation_class.py

c70db1a

Port to Python 3:

ecdb764

use next(generator) instead of generator.next()

Update test_collatex_block_witnesses.py

193351e

enury changed the title ~~Updated project files~~ Updated project files and tests Apr 14, 2015

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Updated project files and tests #19

Updated project files and tests #19

enury commented Feb 11, 2015

Updated project files and tests #19

Are you sure you want to change the base?

Updated project files and tests #19

Conversation

enury commented Feb 11, 2015