SISA CSPAI Dumps

Transformer models leverage self-attention to process entire sequences concurrently, unlike RNNs, which handle inputs sequentially and struggle with long-range dependencies due to vanishing gradients. By computing attention scores across all words, Transformers capture both local and global contexts, enabling better modeling of relationships in tasks like translation or summarization. For example, in a long sentence, attention links distant pronouns to their subjects, improving coherence. This contrasts with RNNs’ sequential limitations, which hinder capturing far-apart dependencies. While parallelism (option C) aids efficiency, the core improvement lies in dependency modeling, not just speed. Exact extract: "The attention mechanism enables Transformers to attend to nearby and distant words simultaneously, significantly improving long-term dependency understanding over RNNs." (Reference: Cyber Security for AI by SISA Study Guide, Section on Transformer vs. RNN Architectures, Page 50-53).

Parameter-efficient fine-tuning (PEFT) strategies, like LoRA or adapters, freeze most pretrained parameters and train only lightweight modules, reducing computational costs while adapting to new tasks. This preserves general knowledge, prevents catastrophic forgetting, and enables quick deployments in resource-constrained settings. For LLMs, it's crucial for efficiency in production, allowing specialization without retraining billions of parameters. Security-wise, it minimizes exposure to new data risks. Exact extract: "A common strategy is freezing the majority of model parameters and updating only a small task-relevant subset, ensuring efficiency in fine-tuning for production deployment." (Reference: Cyber Security for AI by SISA Study Guide, Section on Efficient Fine-Tuning in SDLC, Page 90-92).

Responsible AI standards, including ISO 42001 for AI management systems, aim to promote ethical development, ensuring safety, fairness, and harm prevention in LLM deployments. This encompasses bias mitigation, transparency, and accountability, aligning with societal values. Regulations like the EU AI Act reinforce this by categorizing risks and mandating safeguards. The goal transcends performance to foster trust and sustainability, addressing issues like discrimination or misuse. Exact extract: "The primary goal is to ensure AI systems operate safely, ethically, and without causing harm, as outlined in standards like ISO 42001." (Reference: Cyber Security for AI by SISA Study Guide, Section on Responsible AI and ISO Standards, Page 150-153).