I found that I can type simple html text in paragraph fields like Comment field while adding a new entry, which shows up in the view rendered properly.

But subsequent editing only shows already rendered text to edit, rather than the original html source. Is there a way to turn off html rendering in the paragraph field when editing?

That's been fixed for the next release.