Expose tokens offsets #2

Open

opened

I am trying to integrate tinysegmenter with tantivy
Would it be possible to expose a more advanced API ?

For instance expose the offset of the tokens (expressed in bytes)?

to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests