model = TransformerModel('roberta', 'roberta-base', use_cuda=False, args={'fp16': False})

You have to set both use_cuda and fp16 to False as shown above. I should probably set fp16 to False if cuda is not used by default, but this should work for now.