add initial_prompt parameter?

[silvacarl2]

where could we add the add initial_prompt parameter?

this is really useful when trying to detect certain words, espcially people's names.

[ggerganov]

This is already supported and demonstrated via the --prompt argument of main example.
For example, here we trick Whisper to ignore punctuation, by passing a specific prompt:

$ make -j && ./main -m models/ggml-medium.en.bin samples/gb0.wav -t 8 --prompt "hello how is it going always use lowercase no punctuation goodbye one two three start stop i you me they"
make: Nothing to be done for `default'.
whisper_model_load: loading model from 'models/ggml-medium.en.bin'
whisper_model_load: n_vocab       = 51864
whisper_model_load: n_audio_ctx   = 1500
whisper_model_load: n_audio_state = 1024
whisper_model_load: n_audio_head  = 16
whisper_model_load: n_audio_layer = 24
whisper_model_load: n_text_ctx    = 448
whisper_model_load: n_text_state  = 1024
whisper_model_load: n_text_head   = 16
whisper_model_load: n_text_layer  = 24
whisper_model_load: n_mels        = 80
whisper_model_load: f16           = 1
whisper_model_load: type          = 4
whisper_model_load: adding 1607 extra tokens
whisper_model_load: mem_required  = 2608.00 MB
whisper_model_load: ggml ctx size = 1462.35 MB
whisper_model_load: memory size   =  182.62 MB
whisper_model_load: model size    = 1462.12 MB

initial prompt: 'hello how is it going always use lowercase no punctuation goodbye one two three start stop i you me they'
initial tokens: [ 31373 703 318 340 1016 1464 779 2793 66 589 645 21025 84 341 24829 530 734 1115 923 2245 1312 345 502 484 ]

system_info: n_threads = 8 / 10 | AVX = 0 | AVX2 = 0 | AVX512 = 0 | FMA = 0 | NEON = 1 | ARM_FMA = 1 | F16C = 0 | FP16_VA = 1 | WASM_SIMD = 0 | BLAS = 1 | 

main: processing 'samples/gb0.wav' (2037686 samples, 127.4 sec), 8 threads, 1 processors, lang = en, task = transcribe, timestamps = 1 ...


[00:00:00.000 --> 00:00:03.240]   good morning this tuesday is election day
[00:00:03.240 --> 00:00:07.320]   after months of spirited debate and vigorous campaigning the time has come for americans
[00:00:07.320 --> 00:00:11.680]   to make important decisions about our nation's future i encourage all americans to go to
[00:00:11.680 --> 00:00:16.520]   the polls and vote election season brings out the spirit of competition between our
[00:00:16.520 --> 00:00:21.860]   political parties and that competition is an essential part of a healthy democracy but
[00:00:21.860 --> 00:00:26.800]   as the campaigns come to a close republicans democrats and independents can find common
[00:00:26.800 --> 00:00:32.680]   ground on at least one point our system of representative democracy is one of america's
[00:00:32.680 --> 00:00:38.240]   greatest strengths the united states was founded on the belief that all men are created equal
[00:00:38.240 --> 00:00:43.080]   every election day millions of americans of all races religions and backgrounds step into
[00:00:43.080 --> 00:00:48.080]   voting booths throughout the nation whether they are rich or poor old or young each of
[00:00:48.080 --> 00:00:53.100]   them has an equal share in choosing the path that our country will take and every ballot
[00:00:53.100 --> 00:00:58.880]   they cast is a reminder that our founding principles are alive and well voting is one
[00:00:58.880 --> 00:01:04.440]   of the great privileges of american citizenship and it has always required brave defenders
[00:01:04.440 --> 00:01:09.200]   as you head to the polls next week remember the sacrifices that have been made by generations
[00:01:09.200 --> 00:01:15.080]   of americans in uniform to preserve our way of life from bunker hill to baghdad the men
[00:01:15.080 --> 00:01:20.220]   and women of american armed forces have been devoted guardians of our democracy all of
[00:01:20.220 --> 00:01:25.720]   us owe them and their families a special debt of gratitude on election day americans should
[00:01:25.720 --> 00:01:30.900]   also remember the important example that our elections set throughout the world young democracies
[00:01:30.900 --> 00:01:35.500]   from georgia and ukraine to afghanistan and iraq can look to the united states for proof
[00:01:35.500 --> 00:01:40.400]   that self-government can endure and nations that still live under tyranny and oppression
[00:01:40.400 --> 00:01:45.640]   can find hope and inspiration in our commitment to liberty for more than two centuries americans
[00:01:45.640 --> 00:01:50.240]   have demonstrated the ability of free people to choose their own leaders our nation has
[00:01:50.240 --> 00:01:55.100]   flourished because of its commitment to trusting the wisdom of our citizenry in this year's
[00:01:55.100 --> 00:02:00.480]   election we will see this tradition continue and we will be reminded once again that we
[00:02:00.480 --> 00:02:06.320]   are blessed to live in a free nation guided by the will of the people thank you for listening
[00:02:06.320 --> 00:02:16.320]   [BLANK_AUDIO]


whisper_print_timings:     load time =   615.88 ms
whisper_print_timings:      mel time =    89.90 ms
whisper_print_timings:   sample time =   100.81 ms
whisper_print_timings:   encode time = 13612.64 ms / 567.19 ms per layer
whisper_print_timings:   decode time = 12262.91 ms / 510.95 ms per layer
whisper_print_timings:    total time = 26685.44 ms

[silvacarl2]

dude, what you did with this is amazing thx!