Background Several studies reveal a problematic prevalence of research misbehaviors. There are several potential causes of research misconduct but ensuring that scientists hold attitudes that reflect norms of acceptable behaviors is fundamental. Aim Our aim was to evaluate the psychometric properties (factor structure and reliability) of an “attitude” scale that we adopted from a questionnaire we previously used to investigate the prevalence of research misbehaviors in the Middle East. Methods We used data from participants (n = 254) who were involved in our prior questionnaire study to determine the validity of an attitude scale that we adapted from this previous study. We performed exploratory factor analysis (EFA) to determine the factor structure of the attitude scale followed by measures of convergent and concurrent validity. We assessed reliability by computing the Cronbach’s alphas of each construct of the attitude scale. Results EFA indicated that the attitude scale consists of two factors (constructs). Convergent validity was demonstrated by significant correlations of item-item and item-total. Correlation analysis revealed that the attitude constructs were significantly correlated with the Research Misbehavior Severity Score, thereby demonstrating concurrent validity. Cronbach’s alphas were greater than 0.75 for both constructs. Conclusion We demonstrated a valid and reliable 20-item attitude scale with two factors related to “acceptability of practices in responsible conduct in research” and “general attitudes regarding scientific misconduct”. The use of a validated attitude scale can help assess the effectiveness of educational programs that focus on participants acquiring attitudes that are instrumental in responsible conduct in research.