Rivet & Smith (on page 46) discussed the names of Roman provinces in Britain in a single paragraph, which cuts through some confusion well and is therefore reproduced here almost verbatim:

Herodian (iii, 8) states that Severus divided Britain into two provinces and, whatever the precise date of the division, their names Britannia Superior (administered from London) and Britannia Inferior (administered from York) are given by Cassius Dio (lv, 23, 2) and confirmed by inscriptions.  The later Diocletianic division into four provinces – Britannia Prima (with capital at Cirencester), Britannia Secunda (York? or Lincoln?), Maxima Caesariensis (London), and Flavia Caesariensis (Lincoln? or York?) – is first reflected in the Verona List (Nomina Provinciarum Omnium) of AD 312-314, and the names are repeated in the Breviarium of Festus. The naming of the fifth province, Valentia, is recorded by Ammianus as occurring after Theodosius's campaign of AD 368, and the name recurs in the Notitia Dignitatum and, as Valentiniana, in Polemius Silvius.  The most widely held view is that it was formed by a further subdivision of the most northerly province (Britannia Secunda or Flavia) and was administered from Carlisle; or that the governor of Valentia, as a consularis, ruled from York and Carlisle, became the capital of a reduced province of Flavia or Secunda.