The marine environment is an excellent resource for natural products with therapeutic potential. Its microbial inhabitants, often associated with other marine organisms, are specialized in the synthesis of bioactive secondary metabolites. Similar to their terrestrial counterparts, marine Actinobacteria are a prevalent source of these natural products. Here, we discuss 77 newly discovered alkaloids produced by such marine Actinobacteria between 2017 and mid-2021, as well as the strategies employed in their elucidation. While 12 different classes of alkaloids were unraveled, indoles, diketopiperazines, glutarimides, indolizidines, and pyrroles were most dominant. Discoveries were mainly based on experimental approaches where microbial extracts were analyzed in relation to novel compounds. Although such experimental procedures have proven useful in the past, the methodologies need adaptations to limit the chance of compound rediscovery. On the other hand, genome mining provides a different angle for natural product discovery. While the technology is still relatively young compared to experimental screening, significant improvement has been made in recent years. Together with synthetic biology tools, both genome mining and extract screening provide excellent opportunities for continued drug discovery from marine Actinobacteria.