Natural Language Processing with Python Updated EditionChapter 47

Advanced Understanding

Section 1 of 8-~ 12 min read-Synced from Cuantum content
  1. In the context of BERT, what does "bidirectional" mean?
  2. a) BERT processes text from left to right only.

b) BERT processes text from right to left only.

c) BERT processes text in both directions, capturing context from both sides of a word.

d) BERT processes text without considering direction.

  1. Why is fine-tuning an important step when using pre-trained BERT models for specific NLP tasks?
  2. a) It reduces the model size.

b) It adjusts the model to perform better on specific tasks by training on task-specific data.

c) It simplifies the implementation.

d) It decreases the computational requirements.

  1. What is the primary benefit of using pre-trained models like BERT in NLP?
  2. a) They require no further training.

b) They are always smaller in size.

c) They save time and resources by providing a strong starting point for specific tasks.

d) They eliminate the need for any labeled data.