Skip to content
This repository was archived by the owner on Jul 26, 2019. It is now read-only.
This repository was archived by the owner on Jul 26, 2019. It is now read-only.

How to set up reading comprehension for BERT Keras #26

@Santosh-Gupta

Description

@Santosh-Gupta

I am looking at section 4.2 of the BERT paper or how to set up BERT for reading comprehension. It looks like a module needs to be added to the end of BERT, S and E are new parameters, and a log softmax loss is calculated for the start and end positions.

This extension is included in the original tensorflow BERT in the 'run_squad.py' script in the repository.

Does does an extension exist for BERT Keras?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions