DOAJ, the leading directory service for OA journals, introduces a new application process for OA journals aiming at being listed there (http://doaj.org/application/new) because they are concerned about OA quality.
That's what also comes from DOAJ, and we can help with it:
"Some journal web sites state that the journal is in DOAJ when it is not. Often, the home page carries the DOAJ logo along with logos from other indexing services. Even though we write to these journals, there is no guarantee that they will remove our logo.
I advise the research community to ALWAYS check at www.doaj.org that a journal is indexed with us, even if its web site carries the DOAJ logo or says that it is indexed in DOAJ. You can never be too careful and it only takes as long to check if a journal is in DOAJ as it takes to type the journal name into the search box and press Return.
If you spot a journal that is carrying the DOAJ logo but is not indexed in DOAJ, I would love to hear from you!"