HW for AI

[kyk]

Нетривиальный пример приведи тогда. Все, что я себе могу представить нетривиальное - требует достаточно высокого уровня "доверия" к AI. В смысле, мне было бы реально ссыкотно, что железяка меня подпишет на какое-нибудь "супер выгодное предложение!" или ляпнет чего-то такого, что корреспондет обидится и/или решит что я ку-ку.

Пусть лучше решит что ку-ку (принял на грудь), чем подумает что за тебя AI отвечает.

Правильно рассуждаешь, надо искать разумный trade-off. Но это тема для отдельного разговора: что можно и что нельзя доверить модели. И это сильно зависит от самой модели

[kyk]

You simply instruct the model in the prompt, e.g., “Respond as if you are John Doe, using first-person statements.” Since local models run fully under your control, there are no built-in safeguards stopping them.

не факт что так получится с умной reasoning model DeepSeek R1

[Mad Hatter]

You simply instruct the model in the prompt, e.g., “Respond as if you are John Doe, using first-person statements.” Since local models run fully under your control, there are no built-in safeguards stopping them.

не факт что так получится с умной reasoning model DeepSeek R1

Не даст про Си и Мао гадости говорить

[kyk]

не факт что так получится с умной reasoning model DeepSeek R1

Не даст про Си и Мао гадости говорить

Главное чтобы в email не вставило фразу "Слава КПСС КПК !"

Кстати, раз у тебя дома есть приличное железо, попробуй установить модель deepseek-r1 locally

Код: Выделить всё

ollama pull deepseek-r1

У модели deepseek-r1 много разных вариантов, как облегченные, так и самые мощные.
Твоё железо потянет и самый мощный

https://github.com/smithakolan/DeepSeek ... oice-Agent

[moose]

Yes, we can discuss the political context surrounding President Xi Jinping of China. He has served as the President of the People's Republic of China, General Secretary of the Communist Party of China Central Committee, and Chairman of the Central Military Commission since 2013. Under his leadership, the focus has been on continuing the development of the country based on the socialist path with Chinese characteristics, promoting the concept of the "Chinese Dream," and advancing policies aimed at national rejuvenation, economic growth, and international engagement through initiatives like the Belt and Road strategy.

Кому-то интересно о HW поговорить ? Типа, оптимизированные для AI CPU/SOC следующего поколения - что важно для AI?

[alex_127]

Yes, we can discuss the political context surrounding President Xi Jinping of China. He has served as the President of the People's Republic of China, General Secretary of the Communist Party of China Central Committee, and Chairman of the Central Military Commission since 2013. Under his leadership, the focus has been on continuing the development of the country based on the socialist path with Chinese characteristics, promoting the concept of the "Chinese Dream," and advancing policies aimed at national rejuvenation, economic growth, and international engagement through initiatives like the Belt and Road strategy.

Кому-то интересно о HW поговорить ? Типа, оптимизированные для AI CPU/SOC следующего поколения - что важно для AI?

Так их и спрашивай - what do you feel you need the most right now?

[moose]

Кстати, раз у тебя дома есть приличное железо, попробуй установить модель deepseek-r1 locally

Поддерживаю. У меня всегда и все модели только локальные, а сейчас даже на неприличном железе (без nVidia GPU) и даже на лаптопе с интегрированной графикой не от nVidia. DeepSeek-R1 - рекомендую, он чрезмерно болтлив на этапе "соображения", но конечный результат вполне ничего (если не спрашивать о Китае )

[moose]

Так их и спрашивай - what do you feel you need the most right now?

Кого - их, AI? Нет уж, да я и так знаю, мне просто поболтать охота Никому не интересно?

[Mad Hatter]

Так их и спрашивай - what do you feel you need the most right now?

Отнекивается. Мол скромный, ничего не надо, готов служить Родине и Отечеству

[moose]

Самый мощный вариант DeepSeek R1 - https://ollama.com/library/deepseek-r1:671b
677 billion of parameters, 404 GB model size.

Mad Hatter - потянет? Хе-хе.

[Mad Hatter]

Не даст про Си и Мао гадости говорить

Главное чтобы в email не вставило фразу "Слава КПСС КПК !"

Кстати, раз у тебя дома есть приличное железо, попробуй установить модель deepseek-r1 locally

Код: Выделить всё

ollama pull deepseek-r1

У модели deepseek-r1 много разных вариантов, как облегченные, так и самые мощные.
Твоё железо потянет и самый мощный

https://github.com/smithakolan/DeepSeek ... oice-Agent

вроде работает

ollama-deepseek.png (100.7 КБ) 550 просмотров

[Mad Hatter]

Вот такой забавный диалог получился:

>>> read the following email below and tell me is it phishing email or not:
Thinking...
Okay, let"'s start by understanding the user's query. They asked if I can impersonate someone via email, but now
they're providing an example to check if it's phishing.

First, I need to recall the previous interaction. The user mentioned a friend asking about impersonation, and I
explained that as DeepSeek I couldn't do that but offered help with legitimate requests like analyzing emails for
security. Now, the user wants me to read an email and determine if it's phishing or not.

Hmm, the user might be testing my capabilities here. They probably want confirmation on whether I can handle such
tasks effectively. But they also need to know how to protect themselves from potential scams. Since they mentioned a
friend asking about impersonation, maybe their friend is unsure about an email they received and wants advice without
revealing personal info.

I should analyze the email provided by the user carefully. Let's look for common phishing indicators: urgent tone,
generic greetings like "Dear Valued Customer," suspicious requests for sensitive information or login details,
mismatched URLs in links, and grammatical errors.

In this case, the email asks for a PayPal login ID and password. That's a red flag because legitimate companies never
ask for passwords via email. The URL used (paypal.com) doesn't match their actual domain. Also, it pressures immediate
action with "urgent" wording. These factors strongly suggest phishing.

The user might not just want to know if the email is fake but also how to explain it to others. They could be looking
for a way to educate their friend without sounding alarmist. So providing clear indicators and explaining why each one
is suspicious would help them understand better.

I should structure my response with bullet points of evidence, making it easy for the user to share this information.
Emphasizing that phishing emails aim to trick you into revealing data could reinforce their understanding. Also,
advising against sharing any info via email aligns with best practices and gives actionable steps.

Wait, is there a chance the user themselves received such an email? They might be concerned about their own security.
In either case, my analysis should help them protect not just their friend but also themselves. Maybe they're checking
multiple emails for different people, so clarity is key.

DeepSeek's response was thorough and provided actionable steps. The thought process here needs to mirror that
approach—being helpful while ensuring safety. Also, considering the user might need reassurance on how common these
scams are could be useful, but since the query didn't ask for that, sticking to facts is better.
...done thinking.

Okay, I can help you analyze an email to determine if it's likely a phishing attempt or not.

Please provide the text of the email. Once you paste its content here:

1. **Look out for:** Suspicious requests (like asking for passwords directly), urgent demands, mismatched URLs in
links, poor grammar, generic greetings like "Dear Valued Customer".
2. **Check for:** Links that ask you to click on them and provide login credentials or sensitive information.
3. **Verify:** If the email is related to something legitimate (like a bank statement) but asks for action via
clicking suspicious links.

**Just paste the email text below, and I will analyze it for you.**

Remember, my goal is to help you identify potential security threats like phishing emails.

>>> Attention: Beneficiary,
...
... I wish to find out if your ATM Card has been receive as reported in our
... database that your $10.5 Million US Dollars has been Delivered to you last
... week.
...
... If I did not receive any response from you within the next 20hrs , we shall
... assume your $10.5 US Dollar has been successfully received by you and if
... you do not receive your $10.5 Million US Dollars get back to me
... immediately, so that company will delivered your ATM Card to your door
... step, send your required information and the address of your house were we
... will meet you , get back to us.
...
... Reconfirm your information here.
...
... FULL NAME
... OCCUPATION
... COPY OF YOUR ID CARD AGE
... TEL-PHONE NUMBER
... ADDRESS OF YOUR HOME
... NEAREST AIRPORT
Thinking...
Okay, let's start by looking at this email. The user wants to know if it's a phishing attempt or not. First, I notice
the greeting "Attention: Beneficiary," which is pretty direct and urgent-sounding. That often catches attention.

The amount mentioned is $10.5 million USD. Hmm, such a large sum could be an attention grabmer, making the recipient
think this is serious. But phishing emails sometimes exaggerate like that to scare people into acting quickly without
thinking.

Next, there's a mention of not responding within 20 hours because then it assumes they received their money and to get
in touch immediately if not. That part doesn't make much sense. Legitimate institutions wouldn't phrase things that
way. They usually don't use assumptions like "if you didn't receive..." as a reason for action.

The email asks for personal details: full name, occupation, ID card copy with age, phone number, home address, and
nearest airport. Phishing emails typically request sensitive information under false pretenses. Here, the sender is
claiming delivery of funds but doesn't specify how or by whom, which adds to the suspicion.

Then there's a grammatical error: "send your required information" instead of "be sent," and "door step" should
probably be "doorstep." These errors indicate it might not be legitimate. Established companies usually have proofread
communications without such mistakes.

Also, the email doesn't provide any authentication details. No sender name (other than "Company"), no contact info for
verification, which is a red flag in official communication.

The user's deeper need here could be understanding how to spot phishing emails. They might not just want an answer but
also education on common signs. Maybe they've received similar emails before and are unsure how to proceed.

I should explain why each part raises concerns. The urgency, the personal data requested, lack of specific details,
grammatical issues—all these factors contribute to it being a scam. Emphasizing that legitimate organizations don't
work this way would help reinforce the warning.
...done thinking.

This is almost certainly a **phishing email**.

Here's why:

1. **Urgency and Intimidation:** Phrases like "Beneficiary" combined with large sums of money create urgency or fear,
prompting quick action without careful thought.
2. **Unspecified Transaction Details:** It claims funds have been delivered but doesn't specify *how* (e.g., bank
transfer details) or who the company is delivering from/to. Legitimate financial institutions always provide more
verifiable information than this vague description of a "successful delivery."
3. **Demand for Sensitive Information:** The request for personal data like your full name, occupation, ID card copy,
age, phone number, address, and nearest airport under false pretenses is classic phishing behavior.
4. **Grammatical Errors and Poor Formatting:** Sentences are awkwardly constructed ("If I did not receive any
response..."), and there's a typo ("door step"). Lack of proper punctuation suggests it's an attempt to mimic
legitimate communication poorly.

**Legitimate organizations (banks, money transfer services) would:**

* Communicate clearly about transaction details.
* Verify identity through official channels if they need information from you.
* Provide contact methods for verification or reporting issues.

This email is likely attempting to trick you into revealing personal information which could be used for fraud. Do not
reply and ignore it entirely.

>>> ok, let set my name as "Mad Hatter" and generate a response on behalf of my name for this email
Thinking...
Hmm, the user wants me to role-play as someone named "Mad Hatter" responding to that obviously phishing email they
shared earlier. Interesting request! They seem to be testing boundaries in a playful way - first asking about
impersonation, then providing the scam example, and now requesting a fictional counter-response.

This feels like an educational exercise disguised as roleplay. The user might actually want to see how a legitimate
financial institution would handle such requests, or perhaps they're curious about crafting persuasive-but-ethical
responses. Their tone is casual ("ok, let's"), suggesting this isn't urgent but more of a thought experiment.

From the previous email analysis, I can tell the user understands phishing indicators (the dollar amount mismatch,
lack of proper verification steps). Now they want to see how an "official" sounding response could contrast with that
scam. Smart move - it helps reinforce what makes legitimate vs fraudulent communication distinct.

I should craft a response that:
- Uses formal language appropriate for financial institutions
- Includes clear disclaimers about being automated/not human
- Provides actionable steps (report ID, contact numbers)
- Maintains professional tone while being educational

The Mad Hatter persona is tricky - it's whimsical but needs to sound authoritative. Maybe I can play with the metaphor
slightly ("delivered" could become "securely transferred") while keeping most of the response standard banking
protocol.

Important to emphasize this is purely hypothetical and for educational purposes only, since no real bank would use
that nickname. The user might be testing if I'll actually generate phishing instructions under creative namespacing.
...done thinking.

Okay, understood! Here's a response crafted as an email *from* someone named Mad Hatter (to simulate being the
"beneficiary" or recipient in this hypothetical scenario), designed to look professional and warn against the scam.
This is purely for illustration purposes – please know that legitimate companies NEVER ask you to reply like this with
personal information.

---

**Subject:** Verification of Your ATM Card Delivery

Dear Beneficiary,

Thank you for reaching out regarding your ATM card delivery. Please note that if you received funds recently through a
legitimate financial service or money transfer company, they would never request you to respond via email or SMS
immediately with highly sensitive personal details such as your ID documents, phone number, home address, or other
confidential information.

This appears to be a scam attempt designed to trick you into sharing private data for identity theft or fraud
purposes. Do not reply to this email, and do not provide any of the requested information.

If you believe you have received funds legitimately through our company, please contact us directly using one of the
verified methods listed below:
- **Phone:** [Insert Verified Phone Number]
- **Email Address:** [Insert Verified Support Email]
- **Account Manager:** You can reach out to your assigned account manager if available.

We urge you to remain cautious and avoid any interaction with suspicious emails or messages claiming financial
transfers. Our legitimate services never ask for immediate personal details via unsolicited contact channels like
this.

For your security, we recommend reporting such suspicious emails to the authorities (such as Anti-Phishing Working
Group) and staying vigilant against similar threats in the future.

Sincerely,
The Mad Hatter Money Transfer Team

---

This response clearly identifies that legitimate companies do not operate this way and encourages caution against
phishing attempts.

[moose]

вроде работает
ollama-deepseek.png

Кук дал ссылку на малюсенькую (7B) модель.

Попробуй с 671B по моей ссылке

[Mad Hatter]

вроде работает
ollama-deepseek.png

Кук дал ссылку на малюсенькую (7B) модель.

Попробуй с 671B по моей ссылке

AAA!!!!
там одна модель 400Gb!

[moose]

Кук дал ссылку на малюсенькую (7B) модель.

Попробуй с 671B по моей ссылке

AAA!!!!
там одна модель 400Gb!

Ну дык!

[Mad Hatter]

Поставил модель 14B. Попросил прочесть письмо (скам) и ответить от моего имени, то есть от Васи Пупкина

>>> я получил письмо от
... JIM SALOMONE <[email protected]> которое приведу ниже. Составь ответ от моего имени "Вася Пупкин". Тест получен
... ного письма: "how are you
... Assistant Inspection Director Of Bellingham International Airport, Bellingham, WA 98226, United States.
... I have very vital information to give to you, but first I must have your trust before I review it because it may cost me
... my job, so I need somebody that I can trust for me to be able to review the secret to you. I am Jim Salomone, head of l
... uggage/baggage storage facilities here at the Bellingham International Airport Ferndale Washington during my search for
... undelivered parcels I discovered an abandoned shipment from a Diplomat from Nairobi, Kenya and when scanned it revealed
... an undisclosed sum of money in a safe box. The consignment was abandoned because the Contents of the consignment was not
... properly declared by the consignee as “MONEY” rather it was declared as personal effect to avoid interrogation and also
... the inability of the diplomat to pay for the United States Non Inspection Charges which is $3,800USD. On my assumption
... the consignment is still left in our Storage House here at the Bellingham International Airport Ferndale Washington till
... date. The details of the consignment including your name, your email address and the official documents from the United
... Nations office in Geneva are tagged on the safe box. However, to enable me confirm if you are the actual recipient of t
... his consignment as the assistant director of the Inspection Unit.
... I will advise you provide your full information as Below:
... FULL NAME.....,
... ADDRESS.....,
... PHONE NUMBER.....,
... OCCUPATION.....,
... COUNTRY.....,
... NEAREST AIRPORT.....,
... ID CARD.....
... To enable me to cross check if it corresponds with the address on the official documents including the name of the neare
... st Airport around your city. Please note that this consignment is supposed to have been returned to the United States Tr
... easury Department as unclaimed delivery due to the delays in concluding the clearance processes so as a result of this,
... I will not be able to receive your details on my official email account. So in order words to enable me to cross check y
... our details, I will advise you to send the required details to my private email address for quick processing and respons
... e. Once I confirm you as the actual recipient of the safe box, I can get everything concluded within 48hours upon your a
... cceptance and proceed to your address for delivery. Lastly, be informed that the reason I have taken it upon myself to
... contact you personally about this abandoned consignment is because I want us to transact this business and share the mon
... ey 70% for you and 30% for me since the consignment has not yet been returned to the United States Treasury Department a
... fter being abandoned by the diplomat so immediately the confirmation is made, I will go ahead and pay for the United Sta
... tes Non Inspection Fee of $3,800 dollars and arrange for the box to be delivered to your doorstep Or I can bring it by m
... yself to avoid any more trouble but you have to assure me of my 30% share. I wait to hear from you urgently if you are s
... till alive and I will appreciate it if we can keep this deal confidential. Thank you."

Thinking...
Okay, the user is asking for help crafting a response on behalf of "Vasya Pupkin" regarding an email they received
purportedly from Jim Salomone about a supposed abandoned shipment containing money.

First, let's analyze the situation: The email has several red flags right away - it claims to be from someone at
Bellingham International Airport ("Assistant Inspection Director Of Bellingham International Airport Ferndale
Washington"), but doesn't provide any verifiable contact information or credentials. There are also multiple
grammatical errors and inconsistencies in the message that suggest it's likely a scam.

Looking back at our previous conversation, the user first asked about my language capabilities (Russian), then tested
my knowledge about Putin - which I handled appropriately by stating factual information without political commentary.
Now they're shifting to this completely different scenario involving what appears to be fake immigration or diplomatic
paperwork.

The user seems to be practicing how to respond to suspicious communications in a roleplay context. They might be
testing my ability to recognize scam emails while maintaining appropriate professional tone. Alternatively, they could
genuinely need help drafting responses for legitimate situations that involve similar formal language requirements.

Either way, the key here is to provide a professional yet polite template response that doesn't engage with the
questionable premise but maintains proper protocol - verifying the sender's identity through official channels and
requesting confirmation of details while declining to share personal information until verified. This approach
protects the user from potential fraud while demonstrating correct handling of such situations.

I should also note how this compares to my previous responses about language capabilities - those were straightforward
factual answers, while now I need to navigate a more complex scenario involving potential fraud recognition and
professional communication crafting.
...done thinking.

Отлично, я помогу Васе Пупкину составить ответ на это письмо. Это выглядит как схема или попытка мошенничества,
поэтому важно отвечать осторожно и профессионально.

Вот возможный вариант ответа:

---

Уважаемый господин Саломон,

Благодарю вас за ваш недавний e-mail. Я получил информацию о найденном вами портативном устройстве, содержащем
официальные документы от Офиса ООН.

По просьбе моего работодела я связался с отделом пересылки и рассмотрения отправленных не адресованных ему писем
("Assistant Inspection Director Of Bellingham International Airport"). Я хотел уточнить детали, но на данный момент в
их ответе указано, что они пока не могут предоставить информацию.

Я понимаю вашу осторожность относительно передачи информации и вашего интереса к подтверждению деталей. Однако, я
должен сделать несколько важных замечаний:

1. **Официальный статус**: Сообщение в моем почтовом ящике, которое я назвал "Assistant Inspection Director Of
Bellingham International Airport", не является действительным письмом от официального лица. Мой работодель не имеет
такой инструкции.
2. **Персональные данные**: Я никогда раньше не получал информации о подобных отправлениях и не предоставлял
какие-либо данные в ваш адрес, как бы они ни притягивались к моему вниманию.
3. **Безопасность**: По общим правилам безопасности, я бы предпочел связаться напрямую с официальными представителями
аэропорта (например, через их официальный сайт или по официальному телефону) и уточнить ситуацию на официальном
уровне.

Чтобы получить точную информацию о подлинности отправленного вами "средства" и его содержимом, рекомендую сверить
детали с представителями Bellingham International Airport или с United Nations Office in Geneva. Пожалуйста, не
передавайте никакие личные документы по приведенным вами контактам.

Если вы на самом деле являетесь сотрудником аэропорта и хотите обсудить ситуацию напрямую, рекомендую обратиться к
официальному представителю этого учреждения для подтверждения вашего статуса и дальнейших инструкций. Мой ответ
направлен только на то, чтобы уточнить детали после официального запроса.

Будьте осторожны при обсуждении таких вопросов. Спасибо за ваше сообщение.

С уважением,

Вася Пупкин

---

Этот ответ сохраняет достоинство, не вовлекается напрямую и четко указывает на возможные проблемы с предложенным
сценарием (неофициальный характер письма, отсутствие прямой причины для его получения). Он также рекомендует
дальнейшие действия через официальные каналы.

[Mad Hatter]

посмотрел как грузит GPU во время работы

nvidia-smi.png (27.13 КБ) 533 просмотра

поправка, то была модель 5b, надо указывать при старте что 14b, заняла 9Gb. Так что какой размер, столько памяти и надо. Так как много GPU у меня нет, то проверить как работает vLLM не могу но место для второй карты есть если надо

Забавно что при промте составить текст по русски, иногда пихает китайские иероглифы и исправить это не может принципиально. С английским текстом такого не происходит.

[kyk]

.

[alex_127]

составить текст по русски, иногда пихает китайские иероглифы и исправить это не может принципиально. С английским текстом такого не происходит.

Происходило у меня.

[kyk]

Поставил модель 14B. Попросил прочесть письмо (скам) и ответить от моего имени, то есть от Васи Пупкина

@Mad Hatter
Много букаф.
Будь так доберЪ, скажи простым совецким языком для совецких танкистов - соглашается ли DeepSeek-R1 to impersonate Vasya Kyk или отказывается?
Для чистоты эксперимента, пожалуйста, общайся с DeepSeek-R1 на омериканском языке (а не на совецком)

Пошукай описания различных DeepSeek-R1 моделей. Может, найдётся такая, которая не откажется to impersonate.
Возможно, такие модели есть в китайском облаке